-- Logs begin at Fri 2022-10-28 18:29:29 UTC, end at Fri 2022-10-28 19:18:58 UTC. -- Oct 28 18:59:57.269810 dv-cinder-862365-1-smb systemd[1]: Starting Devstack devstack@keystone.service... Oct 28 18:59:57.279867 dv-cinder-862365-1-smb devstack@keystone.service[81752]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Oct 28 18:59:57.282531 dv-cinder-862365-1-smb devstack@keystone.service[81752]: *** Starting uWSGI 2.0.18-debian (64bit) on [Fri Oct 28 18:59:57 2022] *** Oct 28 18:59:57.282531 dv-cinder-862365-1-smb devstack@keystone.service[81752]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Oct 28 18:59:57.282531 dv-cinder-862365-1-smb devstack@keystone.service[81752]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Oct 28 18:59:57.282531 dv-cinder-862365-1-smb devstack@keystone.service[81752]: nodename: dv-cinder-862365-1-smb Oct 28 18:59:57.282531 dv-cinder-862365-1-smb devstack@keystone.service[81752]: machine: x86_64 Oct 28 18:59:57.282531 dv-cinder-862365-1-smb devstack@keystone.service[81752]: clock source: unix Oct 28 18:59:57.282531 dv-cinder-862365-1-smb devstack@keystone.service[81752]: pcre jit disabled Oct 28 18:59:57.282531 dv-cinder-862365-1-smb devstack@keystone.service[81752]: detected number of CPU cores: 4 Oct 28 18:59:57.282531 dv-cinder-862365-1-smb devstack@keystone.service[81752]: current working directory: / Oct 28 18:59:57.282531 dv-cinder-862365-1-smb devstack@keystone.service[81752]: detected binary path: /usr/bin/uwsgi-core Oct 28 18:59:57.282531 dv-cinder-862365-1-smb devstack@keystone.service[81752]: your processes number limit is 47680 Oct 28 18:59:57.282531 dv-cinder-862365-1-smb devstack@keystone.service[81752]: your memory page size is 4096 bytes Oct 28 18:59:57.282531 dv-cinder-862365-1-smb devstack@keystone.service[81752]: detected max file descriptor number: 2048 Oct 28 18:59:57.282531 dv-cinder-862365-1-smb devstack@keystone.service[81752]: lock engine: pthread robust mutexes Oct 28 18:59:57.283495 dv-cinder-862365-1-smb devstack@keystone.service[81752]: thunder lock: enabled Oct 28 18:59:57.283495 dv-cinder-862365-1-smb devstack@keystone.service[81752]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Oct 28 18:59:57.283495 dv-cinder-862365-1-smb devstack@keystone.service[81752]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Oct 28 18:59:57.320963 dv-cinder-862365-1-smb devstack@keystone.service[81752]: Python main interpreter initialized at 0x557da1dc39c0 Oct 28 18:59:57.320963 dv-cinder-862365-1-smb devstack@keystone.service[81752]: python threads support enabled Oct 28 18:59:57.320963 dv-cinder-862365-1-smb devstack@keystone.service[81752]: your server socket listen backlog is limited to 100 connections Oct 28 18:59:57.320963 dv-cinder-862365-1-smb devstack@keystone.service[81752]: your mercy for graceful operations on workers is 90 seconds Oct 28 18:59:57.321306 dv-cinder-862365-1-smb devstack@keystone.service[81752]: mapped 403077 bytes (393 KB) for 2 cores Oct 28 18:59:57.321438 dv-cinder-862365-1-smb devstack@keystone.service[81752]: *** Operational MODE: preforking *** Oct 28 18:59:57.321705 dv-cinder-862365-1-smb devstack@keystone.service[81752]: *** uWSGI is running in multiple interpreter mode *** Oct 28 18:59:57.321705 dv-cinder-862365-1-smb devstack@keystone.service[81752]: spawned uWSGI master process (pid: 81752) Oct 28 18:59:57.321907 dv-cinder-862365-1-smb systemd[1]: Started Devstack devstack@keystone.service. Oct 28 18:59:57.323001 dv-cinder-862365-1-smb devstack@keystone.service[81752]: spawned uWSGI worker 1 (pid: 81765, cores: 1) Oct 28 18:59:57.323001 dv-cinder-862365-1-smb devstack@keystone.service[81752]: spawned uWSGI worker 2 (pid: 81766, cores: 1) Oct 28 18:59:57.323001 dv-cinder-862365-1-smb devstack@keystone.service[81752]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Oct 28 19:00:01.625766 dv-cinder-862365-1-smb devstack@keystone.service[81766]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 28 19:00:01.625766 dv-cinder-862365-1-smb devstack@keystone.service[81766]: from cryptography.utils import int_from_bytes Oct 28 19:00:01.626570 dv-cinder-862365-1-smb devstack@keystone.service[81766]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 28 19:00:01.626570 dv-cinder-862365-1-smb devstack@keystone.service[81766]: from cryptography.utils import int_from_bytes Oct 28 19:00:01.627858 dv-cinder-862365-1-smb devstack@keystone.service[81765]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 28 19:00:01.627858 dv-cinder-862365-1-smb devstack@keystone.service[81765]: from cryptography.utils import int_from_bytes Oct 28 19:00:01.628331 dv-cinder-862365-1-smb devstack@keystone.service[81765]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 28 19:00:01.628331 dv-cinder-862365-1-smb devstack@keystone.service[81765]: from cryptography.utils import int_from_bytes Oct 28 19:00:01.675421 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 28 19:00:01.675609 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 28 19:00:01.675797 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] command line args: [] {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 28 19:00:01.676062 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 28 19:00:01.676237 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] ================================================================================ {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 28 19:00:01.676486 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] admin_token = **** {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:00:01.676730 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] config_dir = [] {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:00:01.676915 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:00:01.677095 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] config_source = [] {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:00:01.677269 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] debug = True {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:00:01.677492 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:00:01.678909 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:00:01.678909 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:00:01.679096 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 28 19:00:01.679096 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 28 19:00:01.679236 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:00:01.679321 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] command line args: [] {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 28 19:00:01.679401 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:00:01.679479 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 28 19:00:01.679557 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] list_limit = None {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:00:01.679635 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] ================================================================================ {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 28 19:00:01.679713 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] log_config_append = None {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:00:01.679713 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:00:01.679861 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] admin_token = **** {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:00:01.679938 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] log_dir = None {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:00:01.680010 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] config_dir = [] {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:00:01.680081 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] log_file = None {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:00:01.680157 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:00:01.680239 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:00:01.680318 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] config_source = [] {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:00:01.680390 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:00:01.680466 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] debug = True {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:00:01.680550 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:00:01.680633 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:00:01.680736 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:00:01.680819 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:00:01.680897 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:00:01.680976 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:00:01.681056 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:00:01.681135 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:00:01.681208 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:00:01.681279 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:00:01.681386 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:00:01.681463 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] list_limit = None {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:00:01.681551 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:00:01.681631 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] log_config_append = None {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:00:01.681703 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:00:01.681779 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:00:01.681779 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] log_dir = None {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:00:01.681912 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:00:01.681996 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] log_file = None {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:00:01.682074 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:00:01.682146 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:00:01.682227 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:00:01.682300 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:00:01.682376 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:00:01.682512 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:00:01.682663 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:00:01.682765 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:00:01.682948 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:00:01.683082 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.23/identity {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:00:01.683174 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:00:01.683250 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] publish_errors = False {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:00:01.683364 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:00:01.683480 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:00:01.683613 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:00:01.683729 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:00:01.683878 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:00:01.683956 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:00:01.684115 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:00:01.684200 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:00:01.684353 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:00:01.684436 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:00:01.684562 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] standard_threads = False {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:00:01.684638 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:00:01.684792 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:00:01.684881 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:00:01.685031 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:00:01.685160 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:00:01.685237 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:00:01.685375 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:00:01.685519 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] use_journal = False {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:00:01.685650 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] use_json = False {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:00:01.685732 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] use_stderr = False {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:00:01.685844 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.23/identity {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:00:01.685925 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] use_syslog = False {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:00:01.686030 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] publish_errors = False {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:00:01.686110 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:00:01.686266 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:00:01.686344 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.686528 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:00:01.686624 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.686756 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:00:01.686879 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.686956 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:00:01.687072 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.687154 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:00:01.687233 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.687361 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] standard_threads = False {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:00:01.687484 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.687591 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:00:01.687728 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.687838 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:00:01.687925 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.688053 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:00:01.688136 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.688210 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] use_journal = False {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:00:01.688347 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] use_json = False {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:00:01.688433 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.688588 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] use_stderr = False {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:00:01.688664 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.688782 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] use_syslog = False {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:00:01.688864 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.688937 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:00:01.689056 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.689144 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.689290 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.689411 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.689559 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.689678 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.689805 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.689921 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.690039 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.690291 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.690454 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.690534 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.690704 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.690791 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.690955 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.691035 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.691197 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.691280 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.691450 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.691540 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.691701 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.691781 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.691946 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.692024 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.692178 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.692266 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.692407 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.692485 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.692636 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.692715 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.692868 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.692955 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.693116 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.693196 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.693396 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.693480 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.693603 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.693695 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.693834 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.693929 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.694079 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.694164 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.694323 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.694506 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.694573 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.694633 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.694791 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.694877 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.695020 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.695112 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.695254 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.695339 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.695485 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.695570 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.695713 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.695800 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.695940 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.696019 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.696167 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.696252 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.696395 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.696475 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.696628 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.696712 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.696873 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.696953 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.697100 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.697180 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.697332 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.697432 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.697581 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.697659 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.697814 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.697895 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.698044 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.698123 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.698289 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.698406 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.698516 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.698669 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.698777 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.698877 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.698974 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.699085 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.699194 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.699989 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.700142 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.700288 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.700380 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.700456 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.700583 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.700712 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.700791 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.700919 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.700996 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.701135 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.701213 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.701339 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.701536 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.701772 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.701896 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.702002 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.702134 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.702249 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.702364 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.702729 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.702812 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.702874 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.702940 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.703078 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.703157 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.703323 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.703749 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.704252 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.704319 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.704400 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.704475 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.704551 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.704625 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.704693 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.704764 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.704839 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.704913 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.704986 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.705063 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.705136 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.705208 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.705290 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.705427 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.705512 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.705664 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.705746 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.705911 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.705991 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.706147 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.706228 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.706380 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.706460 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.706614 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.706693 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.706842 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.706919 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.707068 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.707154 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.707324 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.707412 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.707562 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.707642 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.707807 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.707892 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.708048 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.708138 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.708281 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.708373 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.708521 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.708602 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.708757 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.708836 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.708990 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.709083 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.709221 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.709301 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.709472 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.709552 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.709702 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.709794 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.710185 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.710278 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.710422 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.710502 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.710651 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.710741 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.710887 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.710966 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.711119 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.711197 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.711365 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.711452 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.711599 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.711679 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.711848 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.711933 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.712095 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.712183 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.712336 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.712415 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.712567 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] auth.external = None {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.712646 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.712796 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.712887 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.713033 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.713112 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.713271 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.713454 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.713533 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.713618 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] auth.password = None {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.713751 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.713839 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] auth.token = None {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.713985 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.714065 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.714213 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.714325 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.714445 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.714534 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.714671 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.714751 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.714915 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.715104 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.715212 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.715802 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.715936 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.716015 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.716169 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] credential.caching = True {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.716250 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.716414 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.716503 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.716658 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.716739 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.716902 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.716983 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] auth.external = None {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.717146 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.717227 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.717403 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.717501 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.717639 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.717720 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.717882 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.717964 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] auth.password = None {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.718131 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.718211 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] auth.token = None {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.718365 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.718446 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.718603 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.718683 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.718857 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.718938 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.719095 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.719182 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.719350 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.719438 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.719585 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.719672 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.719824 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.719904 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.720058 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] federation.caching = True {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.720139 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] credential.caching = True {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.720290 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.720371 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.720545 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.720625 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.720775 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.720858 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.721001 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.721081 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.721242 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.721323 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.721491 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.721579 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.721742 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.721823 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.721977 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.722059 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.722225 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.722307 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.722459 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.722540 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.722702 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.722783 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.722935 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] identity.caching = True {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.723024 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.723181 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.723262 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.723424 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.723505 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.723657 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.723739 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.723888 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.723968 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] federation.caching = True {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.724130 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.724210 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.724357 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.724439 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.724588 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.724668 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.724831 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.724911 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.725077 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.725160 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.725304 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.725441 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.725553 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.725634 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.725780 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.725863 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.726021 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.726103 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.726265 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.726346 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.726508 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.726590 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.726737 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] identity.caching = True {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.726827 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.726988 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.727078 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.727240 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.727321 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.727472 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.727551 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.727704 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.727793 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.727931 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.728012 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.728164 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.728243 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.728391 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.728484 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.728622 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.728703 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.728858 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.728939 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.729094 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.729183 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.729327 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.729446 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.729588 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.729669 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.729828 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.729920 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.730070 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.730151 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.730300 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.730381 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.730542 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.730631 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.730807 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.730888 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.731033 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.731114 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.731265 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.731354 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.731492 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.731573 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.731724 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.731804 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.731955 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.732043 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.732208 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.732307 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.732448 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.732550 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.732695 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.732784 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.732941 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.733022 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.733196 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.733275 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.733458 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.733555 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.733713 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.733794 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.733956 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.734036 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.734192 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.734280 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.734422 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.734501 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.734655 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.734743 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.734889 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.734981 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.735117 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] ldap.user = None {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.735198 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.735350 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.735429 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.735591 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.735680 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.735819 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.735899 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.736062 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.736142 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.736301 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.736388 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.736539 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.736686 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.736764 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.736910 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.736992 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.737166 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.737248 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.737430 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.737515 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.737664 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.737744 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.737892 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.737976 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.738137 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.738217 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.738379 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.738459 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.738619 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.738700 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.738858 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.738938 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.739092 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] ldap.user = None {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.739180 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.739318 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.739397 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.739559 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.739639 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.739792 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.739880 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.740024 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.740107 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.740256 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.740336 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.740486 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.740576 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.740725 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.740805 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.740968 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.741047 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.741198 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.741286 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.741461 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.741543 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.741690 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.741769 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.741926 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.742017 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.742158 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.742238 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.742395 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.742476 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.742628 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.742717 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.742871 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.742958 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.743108 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.743189 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.743336 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.743425 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.743569 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.743650 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.743804 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] resource.caching = True {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.743885 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.744041 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.744196 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.744276 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.744349 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.744498 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.744579 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.744743 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.744831 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.744984 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.745064 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.745215 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.745296 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.745479 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.745574 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.745715 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.745796 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.745950 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.746030 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.746181 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] role.caching = True {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.746270 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.746445 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] role.driver = sql {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.746526 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.746674 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.746754 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.746917 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.747006 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.747160 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.747240 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.747396 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.747477 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.747636 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.747725 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.747878 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.747960 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] resource.caching = True {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.748121 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.748201 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.748362 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.748452 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.748599 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.748679 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.748824 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.748903 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.749067 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.749155 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.749310 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.749438 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.749577 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.749659 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.749817 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.749909 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.750061 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.750211 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.750291 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] role.caching = True {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.750449 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.750538 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] role.driver = sql {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.750699 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.750779 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.750947 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.751027 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.751193 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.751281 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.751438 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.751518 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.751669 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.751749 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.751918 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.752007 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.752165 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.752247 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.752404 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.752485 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.752633 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.752723 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.752862 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.752945 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.753091 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.753171 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.753337 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.753452 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.753611 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.753691 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.753855 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.753934 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.754090 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.754257 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.754339 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.754503 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.754583 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.754761 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] token.caching = True {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.754841 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.754995 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.755077 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.755240 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.755320 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.755474 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.755553 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.755720 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.755802 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.755961 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.756040 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.756195 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.756274 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.756434 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.756516 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.756672 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.756753 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.756906 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.756984 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.757134 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.757215 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.757403 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.757490 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.757621 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.757714 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.757864 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.757945 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.758125 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.758205 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.758349 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.758441 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.758586 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.758677 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.758825 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] token.caching = True {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.758904 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.759067 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.759146 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] database.connection = **** {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.759316 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.759403 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.759552 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.759632 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.759783 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.759862 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.760019 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.760108 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.760250 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.760331 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.760480 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.760561 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.760710 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.760798 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.760940 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.761022 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.761183 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.761291 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.761438 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.761531 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.761677 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.761760 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.762420 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.762505 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.762666 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.762756 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.762901 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.762982 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.763139 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.763230 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.763354 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.763435 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.763581 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.763659 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] database.connection = **** {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.763805 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.763884 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.763959 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 28 19:00:01.764136 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.764380 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.764624 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.764862 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.765101 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.765338 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.765601 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.765847 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.766086 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.766333 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.766571 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.766821 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.767064 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.767311 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.767546 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.767789 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.768027 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:00:01.768200 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 28 19:00:01.804868 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81766) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 28 19:00:01.805097 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81766) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 28 19:00:01.805326 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81766) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 28 19:00:01.805698 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81765) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 28 19:00:01.805937 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81765) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 28 19:00:01.806170 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81765) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 28 19:00:01.813758 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81766) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 28 19:00:01.814714 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81765) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 28 19:00:01.844385 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81766) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 28 19:00:01.844623 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81766) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 28 19:00:01.845235 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81765) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 28 19:00:01.845235 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81765) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 28 19:00:01.906727 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81766) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 28 19:00:01.906884 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81765) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 28 19:00:01.955521 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81766) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 28 19:00:01.955756 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81766) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 28 19:00:01.955853 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81765) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 28 19:00:01.956039 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81765) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 28 19:00:02.109526 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81766) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 28 19:00:02.109756 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81766) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 28 19:00:02.109983 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81766) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 28 19:00:02.110205 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81766) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 28 19:00:02.110331 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81765) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 28 19:00:02.110421 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81766) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 28 19:00:02.110572 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81765) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 28 19:00:02.110658 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81766) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 28 19:00:02.110803 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81765) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 28 19:00:02.111028 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81765) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 28 19:00:02.111252 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81765) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 28 19:00:02.111474 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81765) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 28 19:00:02.133979 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81766) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 28 19:00:02.134211 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81766) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 28 19:00:02.134305 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81765) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 28 19:00:02.134438 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81766) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 28 19:00:02.134525 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81765) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 28 19:00:02.134661 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81766) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 28 19:00:02.134747 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81765) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 28 19:00:02.134881 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81766) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 28 19:00:02.134968 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81765) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 28 19:00:02.135098 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81766) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 28 19:00:02.135183 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81765) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 28 19:00:02.135313 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81766) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 28 19:00:02.135410 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81765) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 28 19:00:02.135587 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81765) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 28 19:00:02.147038 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81766) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 28 19:00:02.147407 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81765) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 28 19:00:02.159862 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81766) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 28 19:00:02.160047 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81766) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 28 19:00:02.160270 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81766) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 28 19:00:02.160356 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81765) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 28 19:00:02.160493 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81766) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 28 19:00:02.160579 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81765) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 28 19:00:02.160713 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81766) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 28 19:00:02.160808 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81765) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 28 19:00:02.160931 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81766) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 28 19:00:02.161017 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81765) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 28 19:00:02.161148 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81766) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 28 19:00:02.161233 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81765) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 28 19:00:02.161391 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81765) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 28 19:00:02.161615 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81765) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 28 19:00:02.177898 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81766) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 19:00:02.178112 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81766) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Oct 28 19:00:02.178250 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81765) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 19:00:02.178456 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81766) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 19:00:02.178545 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81765) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Oct 28 19:00:02.178660 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81766) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Oct 28 19:00:02.178798 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81765) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 19:00:02.178938 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81766) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 19:00:02.179024 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81765) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Oct 28 19:00:02.179202 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81766) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 19:00:02.179287 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81765) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 19:00:02.179529 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81765) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 19:00:02.179716 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81766) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 19:00:02.179799 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81765) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 19:00:02.179983 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81766) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 19:00:02.180067 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81765) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 19:00:02.190230 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81766) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 19:00:02.190331 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81765) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 19:00:02.190515 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81766) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 19:00:02.190601 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81765) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 19:00:02.190789 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81766) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 19:00:02.190876 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81765) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 19:00:02.191072 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81766) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 19:00:02.191159 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81765) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 19:00:02.198092 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81766) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 28 19:00:02.198450 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81765) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 28 19:00:02.201561 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81766) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 28 19:00:02.201849 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81766) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 19:00:02.202061 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81765) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 28 19:00:02.202173 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81766) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 19:00:02.202356 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81765) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 19:00:02.202493 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81766) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 19:00:02.202647 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81765) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 19:00:02.202780 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81766) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 19:00:02.202939 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81765) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 19:00:02.203045 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81766) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 19:00:02.203229 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81765) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 19:00:02.203313 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81766) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 19:00:02.203498 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81765) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 19:00:02.203581 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81766) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 19:00:02.203773 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81765) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 19:00:02.203959 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81766) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 19:00:02.204044 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81765) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 19:00:02.204241 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81766) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 19:00:02.204324 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81765) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 19:00:02.204522 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81766) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 19:00:02.204619 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81765) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 19:00:02.204847 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81765) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 19:00:02.227932 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81766) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 19:00:02.228329 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81765) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 19:00:02.229421 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81766) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 28 19:00:02.229710 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81766) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 19:00:02.229809 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81765) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 28 19:00:02.230103 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81765) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 19:00:02.234869 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81765) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 28 19:00:02.235156 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81765) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 19:00:02.235445 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81765) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 19:00:02.236206 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81766) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 28 19:00:02.236495 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81766) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 19:00:02.236782 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81766) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 19:00:02.241862 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81765) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 28 19:00:02.242159 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81765) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 19:00:02.243400 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81766) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 28 19:00:02.243692 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81766) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 19:00:02.248406 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81765) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 28 19:00:02.248501 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81766) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 28 19:00:02.248709 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81766) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 19:00:02.248792 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81765) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 19:00:02.249012 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81765) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 19:00:02.249097 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81766) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 19:00:02.249310 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81765) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 19:00:02.249443 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81766) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 19:00:02.249624 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81765) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 19:00:02.249721 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81766) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 19:00:02.249923 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81765) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 19:00:02.250008 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81766) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 19:00:02.250202 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81765) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 19:00:02.250285 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81766) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 19:00:02.250479 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81765) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 19:00:02.250563 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81766) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 19:00:02.266751 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81766) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 19:00:02.267033 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81766) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 19:00:02.267504 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81765) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 19:00:02.267789 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81765) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 19:00:02.270913 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81766) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 28 19:00:02.271672 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81765) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 28 19:00:02.274187 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81766) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 19:00:02.274491 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81766) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 19:00:02.274942 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81765) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 19:00:02.275249 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81765) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 19:00:02.278748 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81766) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 28 19:00:02.279534 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81765) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 28 19:00:02.282014 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81766) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 28 19:00:02.282771 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81765) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 28 19:00:02.285232 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81766) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 19:00:02.285564 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81766) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 19:00:02.285856 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81766) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 19:00:02.286018 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81765) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 19:00:02.286154 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81766) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 19:00:02.286329 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81765) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 19:00:02.286449 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81766) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 19:00:02.286632 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81765) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 19:00:02.286742 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81766) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 19:00:02.286942 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81765) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 19:00:02.287245 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81765) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 19:00:02.287523 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81765) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 19:00:02.302507 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81766) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 28 19:00:02.302796 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81766) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 19:00:02.303063 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81766) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 19:00:02.303328 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81766) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 19:00:02.303642 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81765) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 28 19:00:02.303935 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81765) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 19:00:02.304213 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81765) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 19:00:02.304486 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81765) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 19:00:02.310717 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=81766) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 19:00:02.311915 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=81765) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 19:00:02.312338 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81766) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 19:00:02.313494 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81765) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 19:00:02.313934 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81766) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 19:00:02.314215 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81766) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 19:00:02.315045 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81765) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 19:00:02.315331 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81765) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 19:00:02.316844 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81766) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 28 19:00:02.317134 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81766) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 19:00:02.317553 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81766) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 19:00:02.317855 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81766) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 19:00:02.318108 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81765) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 28 19:00:02.318193 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81766) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 19:00:02.318406 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81765) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 19:00:02.318696 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81765) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 19:00:02.318987 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81765) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 19:00:02.319380 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81765) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 19:00:02.329980 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81766) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 28 19:00:02.330280 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81766) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 19:00:02.330684 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81766) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 19:00:02.330956 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81766) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 19:00:02.331115 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81765) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 28 19:00:02.331261 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81766) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 19:00:02.331407 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81765) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 19:00:02.331549 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81766) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 19:00:02.331694 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81765) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 19:00:02.331829 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81766) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 19:00:02.331977 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81765) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 19:00:02.332379 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81765) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 19:00:02.332668 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81765) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 19:00:02.332953 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81765) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 19:00:02.347623 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81766) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 28 19:00:02.348624 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81765) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 28 19:00:02.350552 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81766) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 28 19:00:02.351571 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81765) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 28 19:00:02.353477 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81766) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 19:00:02.354495 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81765) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 19:00:02.354912 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81766) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 19:00:02.356514 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81765) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 19:00:02.357058 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81766) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 28 19:00:02.357365 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81766) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 19:00:02.357654 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81766) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 19:00:02.358022 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81765) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 28 19:00:02.358322 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81765) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 19:00:02.358733 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81765) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 19:00:02.364102 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81766) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 19:00:02.365111 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81765) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 19:00:02.365603 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81766) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 28 19:00:02.366608 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81765) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 28 19:00:02.368615 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81766) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 19:00:02.368911 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81766) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 19:00:02.369198 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81766) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 19:00:02.369502 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81766) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 19:00:02.369640 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81765) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 19:00:02.369905 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81765) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 19:00:02.370198 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81765) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 19:00:02.370486 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81765) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 19:00:02.378002 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81766) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 28 19:00:02.378296 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81766) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 19:00:02.378581 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81766) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 19:00:02.378873 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81765) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 28 19:00:02.379170 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81765) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 19:00:02.379460 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81765) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 19:00:02.386346 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81766) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 28 19:00:02.386435 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81765) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 28 19:00:02.386634 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81766) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 19:00:02.386718 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81765) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 19:00:02.386948 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81766) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 19:00:02.387043 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81765) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 19:00:02.387226 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81766) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 19:00:02.387325 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81765) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 19:00:02.387506 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81766) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 19:00:02.387600 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81765) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 19:00:02.387777 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81766) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 19:00:02.387901 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81765) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 19:00:02.388053 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81766) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 19:00:02.388138 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81765) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 19:00:02.388347 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81766) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 19:00:02.388439 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81765) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 19:00:02.388623 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81765) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 19:00:02.388705 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81766) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 19:00:02.388902 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81765) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 19:00:02.388984 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81766) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 19:00:02.389196 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81766) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 19:00:02.389493 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81766) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 19:00:02.389579 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81765) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 19:00:02.389800 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81765) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 19:00:02.389881 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81766) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 19:00:02.390076 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81765) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 19:00:02.390161 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81766) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 19:00:02.390443 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81765) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 19:00:02.423668 dv-cinder-862365-1-smb devstack@keystone.service[81766]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x557da1dc39c0 pid: 81766 (default app) Oct 28 19:00:02.425582 dv-cinder-862365-1-smb devstack@keystone.service[81765]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x557da1dc39c0 pid: 81765 (default app) Oct 28 19:00:02.426883 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0982c03-8778-47d2-a2b3-441618d14004 None None] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:00:02.427170 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0982c03-8778-47d2-a2b3-441618d14004 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:00:02.427443 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0982c03-8778-47d2-a2b3-441618d14004 None None] PATH_INFO: `/v3` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:00:02.431598 dv-cinder-862365-1-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1/1] 10.222.0.23 () {50 vars in 791 bytes} [Fri Oct 28 19:00:02 2022] GET /identity/v3/ => generated 255 bytes in 7 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:00:09.985919 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97c968a-2e11-48fa-b0e0-25a8ee2287ed None None] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:00:09.986588 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97c968a-2e11-48fa-b0e0-25a8ee2287ed None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:00:09.986588 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97c968a-2e11-48fa-b0e0-25a8ee2287ed None None] PATH_INFO: `/` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:00:09.990784 dv-cinder-862365-1-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 1/2] 10.222.0.23 () {54 vars in 927 bytes} [Fri Oct 28 19:00:09 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 28 19:00:09.996025 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbb46e9-19a3-4d61-96bc-93847fcb7982 None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:00:09.998052 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbb46e9-19a3-4d61-96bc-93847fcb7982 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:00:09.998052 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbb46e9-19a3-4d61-96bc-93847fcb7982 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:00:10.066396 dv-cinder-862365-1-smb devstack@keystone.service[81766]: INFO dbcounter [None req-3cbb46e9-19a3-4d61-96bc-93847fcb7982 None None] Registered counter for database keystone Oct 28 19:00:10.085456 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG oslo_db.sqlalchemy.engines [None req-3cbb46e9-19a3-4d61-96bc-93847fcb7982 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81766) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 28 19:00:10.091710 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writer thread running {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 28 19:00:10.267794 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG passlib.handlers.bcrypt [None req-3cbb46e9-19a3-4d61-96bc-93847fcb7982 None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=81766) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Oct 28 19:00:10.268178 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG passlib.handlers.bcrypt [None req-3cbb46e9-19a3-4d61-96bc-93847fcb7982 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81766) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Oct 28 19:00:10.325739 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-3cbb46e9-19a3-4d61-96bc-93847fcb7982 None None] MFA Rules not processed for user `ae863915635746d1ac19970949de4722`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:00:10.327337 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-3cbb46e9-19a3-4d61-96bc-93847fcb7982 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:00:10.452469 dv-cinder-862365-1-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 2/3] 10.222.0.23 () {58 vars in 1024 bytes} [Fri Oct 28 19:00:09 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 457 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Oct 28 19:00:10.951133 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97c968a-2e11-48fa-b0e0-25a8ee2287ed None None] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:00:11.020724 dv-cinder-862365-1-smb devstack@keystone.service[81765]: INFO dbcounter [None req-e97c968a-2e11-48fa-b0e0-25a8ee2287ed None None] Registered counter for database keystone Oct 28 19:00:11.042260 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG oslo_db.sqlalchemy.engines [None req-e97c968a-2e11-48fa-b0e0-25a8ee2287ed None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81765) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 28 19:00:11.049088 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writer thread running {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 28 19:00:11.166750 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97c968a-2e11-48fa-b0e0-25a8ee2287ed None None] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:00:11.171601 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4fcb90-e47f-4a41-b930-44c4fce07520 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b7477232f9249b8beb26277f784d073', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:00:11.172223 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4fcb90-e47f-4a41-b930-44c4fce07520 admin admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:00:11.172507 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4fcb90-e47f-4a41-b930-44c4fce07520 admin admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:00:11.172782 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4fcb90-e47f-4a41-b930-44c4fce07520 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:00:11.181105 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4fcb90-e47f-4a41-b930-44c4fce07520 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:00:11.232277 dv-cinder-862365-1-smb devstack@keystone.service[81765]: WARNING keystone.common.rbac_enforcer.enforcer [None req-bc4fcb90-e47f-4a41-b930-44c4fce07520 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Oct 28 19:00:11.232615 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4fcb90-e47f-4a41-b930-44c4fce07520 admin admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:00:11.241917 dv-cinder-862365-1-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 2/4] 10.222.0.23 () {58 vars in 1324 bytes} [Fri Oct 28 19:00:10 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 28 19:00:11.247932 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbb46e9-19a3-4d61-96bc-93847fcb7982 None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:00:11.264587 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbb46e9-19a3-4d61-96bc-93847fcb7982 None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:00:11.269056 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9620c9a8-8f2c-4401-a814-8a0b539ea269 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b7477232f9249b8beb26277f784d073', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:00:11.270200 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9620c9a8-8f2c-4401-a814-8a0b539ea269 admin admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:00:11.270488 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9620c9a8-8f2c-4401-a814-8a0b539ea269 admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:00:11.270772 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9620c9a8-8f2c-4401-a814-8a0b539ea269 admin admin] PATH_INFO: `/v3/projects/5b7477232f9249b8beb26277f784d073` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:00:11.274569 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9620c9a8-8f2c-4401-a814-8a0b539ea269 admin admin] RBAC: Authorizing `identity:get_project(project_id=5b7477232f9249b8beb26277f784d073)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:00:11.324472 dv-cinder-862365-1-smb devstack@keystone.service[81766]: WARNING keystone.common.rbac_enforcer.enforcer [None req-9620c9a8-8f2c-4401-a814-8a0b539ea269 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Oct 28 19:00:11.324819 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9620c9a8-8f2c-4401-a814-8a0b539ea269 admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:00:11.329320 dv-cinder-862365-1-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 3/5] 10.222.0.23 () {56 vars in 1207 bytes} [Fri Oct 28 19:00:11 2022] GET /identity/v3/projects/5b7477232f9249b8beb26277f784d073 => generated 344 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:00:13.447290 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9980498d-dfce-4157-8abd-d2b97f4f6a3f None None] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:00:13.447802 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9980498d-dfce-4157-8abd-d2b97f4f6a3f None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:00:13.447909 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9980498d-dfce-4157-8abd-d2b97f4f6a3f None None] PATH_INFO: `/` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:00:13.451922 dv-cinder-862365-1-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 3/6] 10.222.0.23 () {54 vars in 927 bytes} [Fri Oct 28 19:00:13 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 28 19:00:13.457328 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306d3a7c-ea38-4cb4-a657-a42183e8a283 None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:00:13.457724 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306d3a7c-ea38-4cb4-a657-a42183e8a283 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:00:13.457908 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306d3a7c-ea38-4cb4-a657-a42183e8a283 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:00:13.478214 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-306d3a7c-ea38-4cb4-a657-a42183e8a283 None None] MFA Rules not processed for user `ae863915635746d1ac19970949de4722`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:00:13.479712 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-306d3a7c-ea38-4cb4-a657-a42183e8a283 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:00:13.488154 dv-cinder-862365-1-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 4/7] 10.222.0.23 () {58 vars in 1024 bytes} [Fri Oct 28 19:00:13 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Oct 28 19:00:13.755957 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9980498d-dfce-4157-8abd-d2b97f4f6a3f None None] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:00:13.768564 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9980498d-dfce-4157-8abd-d2b97f4f6a3f None None] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:00:13.772802 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c6a539-1736-4270-b4b4-2697961ad4c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b7477232f9249b8beb26277f784d073', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:00:13.773425 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c6a539-1736-4270-b4b4-2697961ad4c3 admin admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:00:13.773711 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c6a539-1736-4270-b4b4-2697961ad4c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:00:13.773984 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c6a539-1736-4270-b4b4-2697961ad4c3 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:00:13.782117 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c6a539-1736-4270-b4b4-2697961ad4c3 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:00:13.783884 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c6a539-1736-4270-b4b4-2697961ad4c3 admin admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:00:13.792494 dv-cinder-862365-1-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 4/8] 10.222.0.23 () {58 vars in 1324 bytes} [Fri Oct 28 19:00:13 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 28 19:00:13.798141 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306d3a7c-ea38-4cb4-a657-a42183e8a283 None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:00:13.807164 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306d3a7c-ea38-4cb4-a657-a42183e8a283 None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:00:13.811592 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b83ff1-2319-4ec0-8be4-52264fb3c698 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b7477232f9249b8beb26277f784d073', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:00:13.812210 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b83ff1-2319-4ec0-8be4-52264fb3c698 admin admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:00:13.812492 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b83ff1-2319-4ec0-8be4-52264fb3c698 admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:00:13.812766 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b83ff1-2319-4ec0-8be4-52264fb3c698 admin admin] PATH_INFO: `/v3/users/ae863915635746d1ac19970949de4722` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:00:13.814102 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b83ff1-2319-4ec0-8be4-52264fb3c698 admin admin] RBAC: Authorizing `identity:get_user(user_id=ae863915635746d1ac19970949de4722)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:00:13.815905 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b83ff1-2319-4ec0-8be4-52264fb3c698 admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:00:13.817427 dv-cinder-862365-1-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 5/9] 10.222.0.23 () {56 vars in 1198 bytes} [Fri Oct 28 19:00:13 2022] GET /identity/v3/users/ae863915635746d1ac19970949de4722 => generated 247 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 19:00:16.018893 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d8a66c-747c-4d38-9cb9-15aa3ebf14e4 None None] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:00:16.019404 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d8a66c-747c-4d38-9cb9-15aa3ebf14e4 None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:00:16.019503 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d8a66c-747c-4d38-9cb9-15aa3ebf14e4 None None] PATH_INFO: `/` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:00:16.020820 dv-cinder-862365-1-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 5/10] 10.222.0.23 () {54 vars in 927 bytes} [Fri Oct 28 19:00:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 28 19:00:16.026227 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c131351-531a-4434-94ad-4c2cc8f17b34 None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:00:16.026629 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c131351-531a-4434-94ad-4c2cc8f17b34 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:00:16.026785 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c131351-531a-4434-94ad-4c2cc8f17b34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:00:16.028721 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17be777c-0bf1-4eba-a5e2-4c2a3ab65423 None None] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:00:16.029012 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17be777c-0bf1-4eba-a5e2-4c2a3ab65423 None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:00:16.029292 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17be777c-0bf1-4eba-a5e2-4c2a3ab65423 None None] PATH_INFO: `/` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:00:16.030721 dv-cinder-862365-1-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 6/11] 10.222.0.23 () {54 vars in 927 bytes} [Fri Oct 28 19:00:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 28 19:00:16.035398 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985bcbf4-3951-4258-9ece-6faa99871255 None None] REQUEST_METHOD: `POST` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:00:16.035683 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985bcbf4-3951-4258-9ece-6faa99871255 None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:00:16.035993 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985bcbf4-3951-4258-9ece-6faa99871255 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:00:16.045815 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-0c131351-531a-4434-94ad-4c2cc8f17b34 None None] MFA Rules not processed for user `ae863915635746d1ac19970949de4722`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:00:16.046997 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-0c131351-531a-4434-94ad-4c2cc8f17b34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:00:16.077832 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG passlib.handlers.bcrypt [None req-985bcbf4-3951-4258-9ece-6faa99871255 None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=81765) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Oct 28 19:00:16.078232 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG passlib.handlers.bcrypt [None req-985bcbf4-3951-4258-9ece-6faa99871255 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81765) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Oct 28 19:00:16.127994 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.auth.core [None req-985bcbf4-3951-4258-9ece-6faa99871255 None None] MFA Rules not processed for user `ae863915635746d1ac19970949de4722`. Rule list: `[]` (Enabled: `True`). {{(pid=81765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:00:16.128278 dv-cinder-862365-1-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 6/12] 10.222.0.23 () {58 vars in 1024 bytes} [Fri Oct 28 19:00:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 28 19:00:16.129695 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-985bcbf4-3951-4258-9ece-6faa99871255 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:00:16.228432 dv-cinder-862365-1-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 7/13] 10.222.0.23 () {58 vars in 1024 bytes} [Fri Oct 28 19:00:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 28 19:00:16.397289 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c131351-531a-4434-94ad-4c2cc8f17b34 None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:00:16.421728 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:00:16.496334 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985bcbf4-3951-4258-9ece-6faa99871255 None None] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:00:16.502072 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c131351-531a-4434-94ad-4c2cc8f17b34 None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:00:16.535517 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c18ab4f-4a14-4fd3-9b4e-8c8d1156fa41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:00:16.536149 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c18ab4f-4a14-4fd3-9b4e-8c8d1156fa41 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:00:16.536435 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c18ab4f-4a14-4fd3-9b4e-8c8d1156fa41 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:00:16.536713 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c18ab4f-4a14-4fd3-9b4e-8c8d1156fa41 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:00:16.549036 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c18ab4f-4a14-4fd3-9b4e-8c8d1156fa41 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 19:00:16.557626 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application [None req-4c18ab4f-4a14-4fd3-9b4e-8c8d1156fa41 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 28 19:00:16.557626 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 19:00:16.557626 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 19:00:16.557626 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 19:00:16.557626 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 19:00:16.557626 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 19:00:16.557626 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 19:00:16.557626 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 19:00:16.557626 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 19:00:16.557626 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 19:00:16.557626 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 19:00:16.557626 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 19:00:16.557626 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 28 19:00:16.557626 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 28 19:00:16.557626 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 28 19:00:16.557626 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 28 19:00:16.558697 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 28 19:00:16.558697 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 28 19:00:16.558697 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 28 19:00:16.558697 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 28 19:00:16.558697 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 19:00:16.558697 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 19:00:16.558697 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 19:00:16.558697 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 19:00:16.558697 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 19:00:16.558697 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 19:00:16.558697 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 19:00:16.558697 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application with Lock( Oct 28 19:00:16.558697 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 19:00:16.558697 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._enter() Oct 28 19:00:16.558697 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 19:00:16.558697 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 19:00:16.559475 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 19:00:16.559475 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.creator() Oct 28 19:00:16.559475 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 19:00:16.559475 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application created_value = creator( Oct 28 19:00:16.559475 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 28 19:00:16.559475 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 28 19:00:16.559475 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 28 19:00:16.559475 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 28 19:00:16.559475 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 28 19:00:16.559475 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 28 19:00:16.559475 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 28 19:00:16.559475 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Oct 28 19:00:16.559475 dv-cinder-862365-1-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 7/14] 10.222.0.23 () {56 vars in 1096 bytes} [Fri Oct 28 19:00:16 2022] GET /identity/v3/roles/admin => generated 83 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 19:00:16.564592 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c18ab4f-4a14-4fd3-9b4e-8c8d1156fa41 None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:00:16.596309 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985bcbf4-3951-4258-9ece-6faa99871255 None None] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:00:16.598584 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:00:16.634477 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ebdeb2-14be-4222-b4ee-d93f7aebed5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:00:16.635348 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ebdeb2-14be-4222-b4ee-d93f7aebed5d None admin] REQUEST_METHOD: `POST` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:00:16.635628 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ebdeb2-14be-4222-b4ee-d93f7aebed5d None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:00:16.635901 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ebdeb2-14be-4222-b4ee-d93f7aebed5d None admin] PATH_INFO: `/v3/domains` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:00:16.637377 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ebdeb2-14be-4222-b4ee-d93f7aebed5d None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:00:16.638812 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ebdeb2-14be-4222-b4ee-d93f7aebed5d None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:00:16.648084 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:00:16.665709 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c18ab4f-4a14-4fd3-9b4e-8c8d1156fa41 None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:00:16.676941 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.sql.core [None req-67ebdeb2-14be-4222-b4ee-d93f7aebed5d None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry '<>-Default' for key 'project.ixu_project_name_domain_id'") Oct 28 19:00:16.676941 dv-cinder-862365-1-smb devstack@keystone.service[81765]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Oct 28 19:00:16.676941 dv-cinder-862365-1-smb devstack@keystone.service[81765]: [parameters: {'id': '2e86a16bca554a1ba67d42d422170733', 'name': 'Default', 'domain_id': '<>', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': None, 'is_domain': 1}] Oct 28 19:00:16.676941 dv-cinder-862365-1-smb devstack@keystone.service[81765]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81765) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Oct 28 19:00:16.695413 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application [None req-67ebdeb2-14be-4222-b4ee-d93f7aebed5d None admin] Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: Default.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: Default. Oct 28 19:00:16.695413 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 19:00:16.695413 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 28 19:00:16.695413 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 28 19:00:16.695413 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 28 19:00:16.695413 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 28 19:00:16.695413 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 28 19:00:16.695413 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application result = self._query(query) Oct 28 19:00:16.695413 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 28 19:00:16.695413 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application conn.query(q) Oct 28 19:00:16.695413 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 28 19:00:16.695413 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 28 19:00:16.695413 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 28 19:00:16.695413 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application result.read() Oct 28 19:00:16.696363 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 28 19:00:16.696363 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 28 19:00:16.696363 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 28 19:00:16.696363 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 28 19:00:16.696363 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 28 19:00:16.696363 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 28 19:00:16.696363 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 28 19:00:16.696363 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 28 19:00:16.696363 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry '<>-Default' for key 'project.ixu_project_name_domain_id'") Oct 28 19:00:16.696363 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application Oct 28 19:00:16.696363 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Oct 28 19:00:16.696363 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application Oct 28 19:00:16.696363 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 19:00:16.696363 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Oct 28 19:00:16.696363 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return method(*args, **kwargs) Oct 28 19:00:16.696363 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Oct 28 19:00:16.696363 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return project_ref.to_dict() Oct 28 19:00:16.696363 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 28 19:00:16.697452 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application next(self.gen) Oct 28 19:00:16.697452 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1068, in _transaction_scope Oct 28 19:00:16.697452 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application yield resource Oct 28 19:00:16.697452 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 28 19:00:16.697452 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application next(self.gen) Oct 28 19:00:16.697452 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 670, in _session Oct 28 19:00:16.697452 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application self.session.rollback() Oct 28 19:00:16.697452 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 28 19:00:16.697452 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application self.force_reraise() Oct 28 19:00:16.697452 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 28 19:00:16.697452 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application raise self.value Oct 28 19:00:16.697452 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 667, in _session Oct 28 19:00:16.697452 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Oct 28 19:00:16.697452 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 695, in _end_session_transaction Oct 28 19:00:16.697452 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application session.commit() Oct 28 19:00:16.697452 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Oct 28 19:00:16.697452 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Oct 28 19:00:16.698483 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Oct 28 19:00:16.698483 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application self._prepare_impl() Oct 28 19:00:16.698483 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Oct 28 19:00:16.698483 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application self.session.flush() Oct 28 19:00:16.698483 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 28 19:00:16.698483 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application self._flush(objects) Oct 28 19:00:16.698483 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 28 19:00:16.698483 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Oct 28 19:00:16.698483 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 28 19:00:16.698483 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application compat.raise_( Oct 28 19:00:16.698483 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 28 19:00:16.698483 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application raise exception Oct 28 19:00:16.698483 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 28 19:00:16.698483 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application flush_context.execute() Oct 28 19:00:16.698483 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 28 19:00:16.698483 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application rec.execute(self) Oct 28 19:00:16.698483 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 28 19:00:16.700306 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Oct 28 19:00:16.700306 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 28 19:00:16.700306 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application _emit_insert_statements( Oct 28 19:00:16.700306 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Oct 28 19:00:16.700306 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application c = connection._execute_20( Oct 28 19:00:16.700306 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 28 19:00:16.700306 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Oct 28 19:00:16.700306 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 28 19:00:16.700306 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Oct 28 19:00:16.700306 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 28 19:00:16.700306 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application ret = self._execute_context( Oct 28 19:00:16.700306 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 28 19:00:16.700306 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Oct 28 19:00:16.700306 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 28 19:00:16.700306 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 28 19:00:16.701378 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 28 19:00:16.701378 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application raise exception Oct 28 19:00:16.701378 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 28 19:00:16.701378 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 28 19:00:16.701378 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 28 19:00:16.701378 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 28 19:00:16.701378 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 28 19:00:16.701378 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application result = self._query(query) Oct 28 19:00:16.701378 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 28 19:00:16.701378 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application conn.query(q) Oct 28 19:00:16.701378 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 28 19:00:16.701378 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 28 19:00:16.701378 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 28 19:00:16.701378 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application result.read() Oct 28 19:00:16.701378 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 28 19:00:16.701378 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 28 19:00:16.701378 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 28 19:00:16.702484 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 28 19:00:16.702484 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 28 19:00:16.702484 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 28 19:00:16.702484 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 28 19:00:16.702484 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 28 19:00:16.702484 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry '<>-Default' for key 'project.ixu_project_name_domain_id'") Oct 28 19:00:16.702484 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Oct 28 19:00:16.702484 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application [parameters: {'id': '2e86a16bca554a1ba67d42d422170733', 'name': 'Default', 'domain_id': '<>', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': None, 'is_domain': 1}] Oct 28 19:00:16.702484 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 28 19:00:16.702484 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application Oct 28 19:00:16.702484 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 28 19:00:16.702484 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application Oct 28 19:00:16.702484 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 19:00:16.702484 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Oct 28 19:00:16.702484 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Oct 28 19:00:16.703383 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Oct 28 19:00:16.703383 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Oct 28 19:00:16.703383 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name Default. Oct 28 19:00:16.703383 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application Oct 28 19:00:16.703383 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 28 19:00:16.703383 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application Oct 28 19:00:16.703383 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 19:00:16.703383 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 19:00:16.703383 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 19:00:16.703383 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 19:00:16.703383 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 19:00:16.703383 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 19:00:16.703383 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 19:00:16.703383 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 19:00:16.703383 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 19:00:16.703383 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 19:00:16.703383 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 19:00:16.704596 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 128, in post Oct 28 19:00:16.704596 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_domain( Oct 28 19:00:16.704596 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 19:00:16.704596 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 19:00:16.704596 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 765, in create_domain Oct 28 19:00:16.704596 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application is_domain_project = self.create_project( Oct 28 19:00:16.704596 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 19:00:16.704596 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 19:00:16.704596 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Oct 28 19:00:16.704596 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application raise exception.Conflict( Oct 28 19:00:16.704596 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: Default. Oct 28 19:00:16.704596 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application Oct 28 19:00:16.704596 dv-cinder-862365-1-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 8/15] 10.222.0.23 () {60 vars in 1137 bytes} [Fri Oct 28 19:00:16 2022] POST /identity/v3/domains => generated 190 bytes in 201 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Oct 28 19:00:16.705416 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a85fca-d2e6-425d-8fe8-20ac812fbacf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:00:16.705416 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a85fca-d2e6-425d-8fe8-20ac812fbacf None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:00:16.705578 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ebdeb2-14be-4222-b4ee-d93f7aebed5d None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:00:16.705669 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a85fca-d2e6-425d-8fe8-20ac812fbacf None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:00:16.705669 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a85fca-d2e6-425d-8fe8-20ac812fbacf None admin] PATH_INFO: `/v3/roles` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:00:16.705669 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a85fca-d2e6-425d-8fe8-20ac812fbacf None admin] RBAC: Adding query filter params (name=admin) {{(pid=81766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:00:16.705669 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a85fca-d2e6-425d-8fe8-20ac812fbacf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:00:16.705929 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a85fca-d2e6-425d-8fe8-20ac812fbacf None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:00:16.719268 dv-cinder-862365-1-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 8/16] 10.222.0.23 () {56 vars in 1099 bytes} [Fri Oct 28 19:00:16 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 19:00:16.724753 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a85fca-d2e6-425d-8fe8-20ac812fbacf None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:00:16.804348 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ebdeb2-14be-4222-b4ee-d93f7aebed5d None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:00:16.823540 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a85fca-d2e6-425d-8fe8-20ac812fbacf None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:00:16.848260 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd13ac5-dbbf-497a-801d-582e4ee17bf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:00:16.849363 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd13ac5-dbbf-497a-801d-582e4ee17bf3 None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:00:16.849658 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd13ac5-dbbf-497a-801d-582e4ee17bf3 None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:00:16.849981 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd13ac5-dbbf-497a-801d-582e4ee17bf3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:00:16.863023 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7664618-15f7-4656-9387-26ca57519352 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:00:16.863659 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7664618-15f7-4656-9387-26ca57519352 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:00:16.863943 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7664618-15f7-4656-9387-26ca57519352 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:00:16.864221 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7664618-15f7-4656-9387-26ca57519352 None admin] PATH_INFO: `/v3/users/ae863915635746d1ac19970949de4722` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:00:16.865406 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7664618-15f7-4656-9387-26ca57519352 None admin] RBAC: Authorizing `identity:get_user(user_id=ae863915635746d1ac19970949de4722)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:00:16.866860 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7664618-15f7-4656-9387-26ca57519352 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:00:16.868384 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd13ac5-dbbf-497a-801d-582e4ee17bf3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:00:16.868497 dv-cinder-862365-1-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 9/17] 10.222.0.23 () {56 vars in 1177 bytes} [Fri Oct 28 19:00:16 2022] GET /identity/v3/users/ae863915635746d1ac19970949de4722 => generated 247 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 19:00:16.869974 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd13ac5-dbbf-497a-801d-582e4ee17bf3 None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:00:16.873734 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7664618-15f7-4656-9387-26ca57519352 None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:00:16.886094 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application [None req-9fd13ac5-dbbf-497a-801d-582e4ee17bf3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 19:00:16.886094 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 19:00:16.886094 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 19:00:16.886094 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 19:00:16.886094 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 19:00:16.886094 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 19:00:16.886094 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 19:00:16.886094 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 19:00:16.886094 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 19:00:16.886094 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 19:00:16.886094 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 19:00:16.886094 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 19:00:16.886094 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 28 19:00:16.886094 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 28 19:00:16.886094 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 28 19:00:16.886094 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 28 19:00:16.887517 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 19:00:16.887517 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 19:00:16.887517 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 19:00:16.887517 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 19:00:16.887517 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 19:00:16.887517 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 19:00:16.887517 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 19:00:16.887517 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application with Lock( Oct 28 19:00:16.887517 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 19:00:16.887517 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._enter() Oct 28 19:00:16.887517 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 19:00:16.887517 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 19:00:16.887517 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 19:00:16.887517 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.creator() Oct 28 19:00:16.887517 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 19:00:16.887517 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application created_value = creator( Oct 28 19:00:16.887517 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 28 19:00:16.888387 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 28 19:00:16.888387 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 19:00:16.888387 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application Oct 28 19:00:16.888387 dv-cinder-862365-1-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 9/18] 10.222.0.23 () {56 vars in 1108 bytes} [Fri Oct 28 19:00:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 19:00:16.888728 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:00:16.893592 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd13ac5-dbbf-497a-801d-582e4ee17bf3 None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:00:16.915547 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:00:16.972196 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7664618-15f7-4656-9387-26ca57519352 None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:00:16.991940 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd13ac5-dbbf-497a-801d-582e4ee17bf3 None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:00:17.006409 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3add6d42-ed33-4a54-8053-c579fc4a56ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:00:17.007079 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3add6d42-ed33-4a54-8053-c579fc4a56ac None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:00:17.007344 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3add6d42-ed33-4a54-8053-c579fc4a56ac None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:00:17.007614 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3add6d42-ed33-4a54-8053-c579fc4a56ac None admin] PATH_INFO: `/v3/domains/default` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:00:17.008745 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3add6d42-ed33-4a54-8053-c579fc4a56ac None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:00:17.010225 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3add6d42-ed33-4a54-8053-c579fc4a56ac None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:00:17.012359 dv-cinder-862365-1-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 10/19] 10.222.0.23 () {56 vars in 1108 bytes} [Fri Oct 28 19:00:16 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 19:00:17.018004 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3add6d42-ed33-4a54-8053-c579fc4a56ac None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:00:17.028192 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1aaa60-ece2-426f-a9e0-f898e4990104 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:00:17.028799 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1aaa60-ece2-426f-a9e0-f898e4990104 None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:00:17.029081 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1aaa60-ece2-426f-a9e0-f898e4990104 None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:00:17.029375 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1aaa60-ece2-426f-a9e0-f898e4990104 None admin] PATH_INFO: `/v3/domains` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:00:17.030045 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b1aaa60-ece2-426f-a9e0-f898e4990104 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81765) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:00:17.030406 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b1aaa60-ece2-426f-a9e0-f898e4990104 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:00:17.031783 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b1aaa60-ece2-426f-a9e0-f898e4990104 None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:00:17.048616 dv-cinder-862365-1-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 10/20] 10.222.0.23 () {56 vars in 1109 bytes} [Fri Oct 28 19:00:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 19:00:17.101967 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:00:17.122288 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3add6d42-ed33-4a54-8053-c579fc4a56ac None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:00:17.158137 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d426d293-5dc0-4816-8c59-2be2a7afe81f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:00:17.158816 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d426d293-5dc0-4816-8c59-2be2a7afe81f None admin] REQUEST_METHOD: `PUT` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:00:17.159096 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d426d293-5dc0-4816-8c59-2be2a7afe81f None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:00:17.159374 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d426d293-5dc0-4816-8c59-2be2a7afe81f None admin] PATH_INFO: `/v3/domains/default/users/ae863915635746d1ac19970949de4722/roles/a9e4e47c2bf448fcbada91c1174644f7` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:00:17.161479 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d426d293-5dc0-4816-8c59-2be2a7afe81f None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=ae863915635746d1ac19970949de4722, role_id=a9e4e47c2bf448fcbada91c1174644f7)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:00:17.162968 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d426d293-5dc0-4816-8c59-2be2a7afe81f None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:00:17.347431 dv-cinder-862365-1-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 11/21] 10.222.0.23 () {58 vars in 1361 bytes} [Fri Oct 28 19:00:17 2022] PUT /identity/v3/domains/default/users/ae863915635746d1ac19970949de4722/roles/a9e4e47c2bf448fcbada91c1174644f7 => generated 0 bytes in 330 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 19:00:19.801422 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02f2001-c8a2-4f2d-84d2-7c791c1aef06 None None] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:00:19.802027 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02f2001-c8a2-4f2d-84d2-7c791c1aef06 None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:00:19.802027 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02f2001-c8a2-4f2d-84d2-7c791c1aef06 None None] PATH_INFO: `/` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:00:19.803803 dv-cinder-862365-1-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 11/22] 10.222.0.23 () {54 vars in 927 bytes} [Fri Oct 28 19:00:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 19:00:19.810386 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268289eb-356f-4c4d-a575-a64b73851395 None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:00:19.811039 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268289eb-356f-4c4d-a575-a64b73851395 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:00:19.811039 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268289eb-356f-4c4d-a575-a64b73851395 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:00:19.839447 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-268289eb-356f-4c4d-a575-a64b73851395 None None] MFA Rules not processed for user `ae863915635746d1ac19970949de4722`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:00:19.846767 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-268289eb-356f-4c4d-a575-a64b73851395 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:00:19.929397 dv-cinder-862365-1-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 12/23] 10.222.0.23 () {58 vars in 1024 bytes} [Fri Oct 28 19:00:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 28 19:00:19.940793 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7d2124-6b91-4c12-b474-5e3152a7c53a None None] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:00:19.941061 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7d2124-6b91-4c12-b474-5e3152a7c53a None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:00:19.941335 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7d2124-6b91-4c12-b474-5e3152a7c53a None None] PATH_INFO: `/` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:00:19.942676 dv-cinder-862365-1-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 12/24] 10.222.0.23 () {54 vars in 927 bytes} [Fri Oct 28 19:00:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 28 19:00:19.959237 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945fabe1-5a26-42e0-bcb5-1fd5772d6c26 None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:00:19.959513 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945fabe1-5a26-42e0-bcb5-1fd5772d6c26 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:00:19.959796 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945fabe1-5a26-42e0-bcb5-1fd5772d6c26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:00:19.986345 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-945fabe1-5a26-42e0-bcb5-1fd5772d6c26 None None] MFA Rules not processed for user `ae863915635746d1ac19970949de4722`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:00:19.987534 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-945fabe1-5a26-42e0-bcb5-1fd5772d6c26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:00:20.043586 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e339cf-d5da-4e93-b2bb-fae35e590cf6 None None] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:00:20.043917 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e339cf-d5da-4e93-b2bb-fae35e590cf6 None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:00:20.044126 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e339cf-d5da-4e93-b2bb-fae35e590cf6 None None] PATH_INFO: `/` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:00:20.045487 dv-cinder-862365-1-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 13/25] 10.222.0.23 () {54 vars in 927 bytes} [Fri Oct 28 19:00:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 28 19:00:20.051593 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8dc4098-80f5-4ab8-9025-760e281acc6b None None] REQUEST_METHOD: `POST` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:00:20.051873 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8dc4098-80f5-4ab8-9025-760e281acc6b None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:00:20.052056 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8dc4098-80f5-4ab8-9025-760e281acc6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:00:20.082462 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.auth.core [None req-d8dc4098-80f5-4ab8-9025-760e281acc6b None None] MFA Rules not processed for user `ae863915635746d1ac19970949de4722`. Rule list: `[]` (Enabled: `True`). {{(pid=81765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:00:20.084256 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-d8dc4098-80f5-4ab8-9025-760e281acc6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:00:20.095525 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:00:20.106366 dv-cinder-862365-1-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 13/26] 10.222.0.23 () {58 vars in 1024 bytes} [Fri Oct 28 19:00:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 28 19:00:20.198684 dv-cinder-862365-1-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 14/27] 10.222.0.23 () {58 vars in 1024 bytes} [Fri Oct 28 19:00:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 28 19:00:20.388568 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598e9d18-9832-498e-9288-c63e1d255a1d None None] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:00:20.388778 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598e9d18-9832-498e-9288-c63e1d255a1d None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:00:20.389059 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598e9d18-9832-498e-9288-c63e1d255a1d None None] PATH_INFO: `/` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:00:20.393928 dv-cinder-862365-1-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 14/28] 10.222.0.23 () {54 vars in 927 bytes} [Fri Oct 28 19:00:20 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 19:00:20.403148 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8dc4098-80f5-4ab8-9025-760e281acc6b None None] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:00:20.408985 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38392f77-c58f-44d8-a931-d5819318b2f0 None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:00:20.409274 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38392f77-c58f-44d8-a931-d5819318b2f0 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:00:20.409594 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38392f77-c58f-44d8-a931-d5819318b2f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:00:20.415600 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:00:20.439553 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-38392f77-c58f-44d8-a931-d5819318b2f0 None None] MFA Rules not processed for user `ae863915635746d1ac19970949de4722`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:00:20.441382 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-38392f77-c58f-44d8-a931-d5819318b2f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:00:20.546715 dv-cinder-862365-1-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 15/29] 10.222.0.23 () {58 vars in 1024 bytes} [Fri Oct 28 19:00:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 28 19:00:20.548053 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38392f77-c58f-44d8-a931-d5819318b2f0 None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:00:20.580339 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8dc4098-80f5-4ab8-9025-760e281acc6b None None] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:00:20.643803 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be06bbf-191d-4713-bac4-327f447ea614 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:00:20.646901 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be06bbf-191d-4713-bac4-327f447ea614 None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:00:20.647193 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be06bbf-191d-4713-bac4-327f447ea614 None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:00:20.647474 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be06bbf-191d-4713-bac4-327f447ea614 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:00:20.663276 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be06bbf-191d-4713-bac4-327f447ea614 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:00:20.666097 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be06bbf-191d-4713-bac4-327f447ea614 None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:00:20.694722 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application [None req-2be06bbf-191d-4713-bac4-327f447ea614 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 19:00:20.694722 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 19:00:20.694722 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 19:00:20.694722 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 19:00:20.694722 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 19:00:20.694722 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 19:00:20.694722 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 19:00:20.694722 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 19:00:20.694722 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 19:00:20.694722 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 19:00:20.694722 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 19:00:20.694722 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 19:00:20.694722 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 28 19:00:20.694722 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 28 19:00:20.694722 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 28 19:00:20.694722 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 28 19:00:20.695666 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 19:00:20.695666 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 19:00:20.695666 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 19:00:20.695666 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 19:00:20.695666 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 19:00:20.695666 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 19:00:20.695666 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 19:00:20.695666 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application with Lock( Oct 28 19:00:20.695666 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 19:00:20.695666 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._enter() Oct 28 19:00:20.695666 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 19:00:20.695666 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 19:00:20.695666 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 19:00:20.695666 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.creator() Oct 28 19:00:20.695666 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 19:00:20.695666 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application created_value = creator( Oct 28 19:00:20.695666 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 28 19:00:20.696486 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 28 19:00:20.696486 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 19:00:20.696486 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application Oct 28 19:00:20.696486 dv-cinder-862365-1-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 15/30] 10.222.0.23 () {56 vars in 1108 bytes} [Fri Oct 28 19:00:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 293 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 19:00:20.696704 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be06bbf-191d-4713-bac4-327f447ea614 None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:00:20.732006 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38392f77-c58f-44d8-a931-d5819318b2f0 None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:00:20.785455 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:00:20.798064 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea0b3b5-2036-4bc0-8a02-6c29cdbe669c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:00:20.798681 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea0b3b5-2036-4bc0-8a02-6c29cdbe669c None admin] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:00:20.798957 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea0b3b5-2036-4bc0-8a02-6c29cdbe669c None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:00:20.799227 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea0b3b5-2036-4bc0-8a02-6c29cdbe669c None admin] PATH_INFO: `/v3/roles` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:00:20.799958 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea0b3b5-2036-4bc0-8a02-6c29cdbe669c None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:00:20.801484 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea0b3b5-2036-4bc0-8a02-6c29cdbe669c None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:00:20.819521 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:00:20.862338 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be06bbf-191d-4713-bac4-327f447ea614 None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:00:20.900292 dv-cinder-862365-1-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 16/31] 10.222.0.23 () {60 vars in 1131 bytes} [Fri Oct 28 19:00:20 2022] POST /identity/v3/roles => generated 225 bytes in 352 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 19:00:20.901972 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea0b3b5-2036-4bc0-8a02-6c29cdbe669c None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:00:20.914914 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f4bc14-3360-4e77-9538-45382c53f281 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:00:20.915646 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f4bc14-3360-4e77-9538-45382c53f281 None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:00:20.915934 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f4bc14-3360-4e77-9538-45382c53f281 None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:00:20.916312 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f4bc14-3360-4e77-9538-45382c53f281 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:00:20.933182 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f4bc14-3360-4e77-9538-45382c53f281 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 19:00:20.940259 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application [None req-62f4bc14-3360-4e77-9538-45382c53f281 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 28 19:00:20.940259 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 19:00:20.940259 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 19:00:20.940259 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 19:00:20.940259 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 19:00:20.940259 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 19:00:20.940259 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 19:00:20.940259 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 19:00:20.940259 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 19:00:20.940259 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 19:00:20.940259 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 19:00:20.940259 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 19:00:20.940259 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 28 19:00:20.940259 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 28 19:00:20.940259 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 28 19:00:20.940259 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 28 19:00:20.941142 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 28 19:00:20.941142 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 28 19:00:20.941142 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 28 19:00:20.941142 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 28 19:00:20.941142 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 19:00:20.941142 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 19:00:20.941142 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 19:00:20.941142 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 19:00:20.941142 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 19:00:20.941142 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 19:00:20.941142 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 19:00:20.941142 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application with Lock( Oct 28 19:00:20.941142 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 19:00:20.941142 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._enter() Oct 28 19:00:20.941142 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 19:00:20.941142 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 19:00:20.941947 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 19:00:20.941947 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.creator() Oct 28 19:00:20.941947 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 19:00:20.941947 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application created_value = creator( Oct 28 19:00:20.941947 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 28 19:00:20.941947 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 28 19:00:20.941947 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 28 19:00:20.941947 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 28 19:00:20.941947 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 28 19:00:20.941947 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 28 19:00:20.941947 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 28 19:00:20.941947 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application Oct 28 19:00:20.944492 dv-cinder-862365-1-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 16/32] 10.222.0.23 () {56 vars in 1096 bytes} [Fri Oct 28 19:00:20 2022] GET /identity/v3/roles/admin => generated 83 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 19:00:20.945542 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f4bc14-3360-4e77-9538-45382c53f281 None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:00:21.024906 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea0b3b5-2036-4bc0-8a02-6c29cdbe669c None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:00:21.057927 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f4bc14-3360-4e77-9538-45382c53f281 None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:00:21.064570 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a937055-a86e-4ece-bfe2-5afc474ff39a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:00:21.065559 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a937055-a86e-4ece-bfe2-5afc474ff39a None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:00:21.066001 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a937055-a86e-4ece-bfe2-5afc474ff39a None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:00:21.066431 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a937055-a86e-4ece-bfe2-5afc474ff39a None admin] PATH_INFO: `/v3/domains` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:00:21.067257 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a937055-a86e-4ece-bfe2-5afc474ff39a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:00:21.067790 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a937055-a86e-4ece-bfe2-5afc474ff39a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:00:21.069474 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a937055-a86e-4ece-bfe2-5afc474ff39a None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:00:21.084431 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:00:21.091008 dv-cinder-862365-1-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 17/33] 10.222.0.23 () {56 vars in 1109 bytes} [Fri Oct 28 19:00:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:00:21.097584 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a937055-a86e-4ece-bfe2-5afc474ff39a None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:00:21.105955 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846badc2-5b2b-478a-bc3a-b7e3f59fe747 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:00:21.105955 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846badc2-5b2b-478a-bc3a-b7e3f59fe747 None admin] REQUEST_METHOD: `POST` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:00:21.105955 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846badc2-5b2b-478a-bc3a-b7e3f59fe747 None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:00:21.105955 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846badc2-5b2b-478a-bc3a-b7e3f59fe747 None admin] PATH_INFO: `/v3/roles` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:00:21.106307 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846badc2-5b2b-478a-bc3a-b7e3f59fe747 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:00:21.106307 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846badc2-5b2b-478a-bc3a-b7e3f59fe747 None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:00:21.157027 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:00:21.215412 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a937055-a86e-4ece-bfe2-5afc474ff39a None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:00:21.252365 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648c10fb-2dee-41b1-a49f-d8f5008a0276 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:00:21.253341 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648c10fb-2dee-41b1-a49f-d8f5008a0276 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:00:21.253834 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648c10fb-2dee-41b1-a49f-d8f5008a0276 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:00:21.254257 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648c10fb-2dee-41b1-a49f-d8f5008a0276 None admin] PATH_INFO: `/v3/roles` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:00:21.255109 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648c10fb-2dee-41b1-a49f-d8f5008a0276 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:00:21.255580 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648c10fb-2dee-41b1-a49f-d8f5008a0276 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:00:21.257216 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648c10fb-2dee-41b1-a49f-d8f5008a0276 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:00:21.266580 dv-cinder-862365-1-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 18/34] 10.222.0.23 () {56 vars in 1099 bytes} [Fri Oct 28 19:00:21 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:00:21.267871 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d17f3a-0990-47e4-bfff-403a36837008 None None] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:00:21.268377 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d17f3a-0990-47e4-bfff-403a36837008 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:00:21.268798 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d17f3a-0990-47e4-bfff-403a36837008 None None] PATH_INFO: `/` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:00:21.270269 dv-cinder-862365-1-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 19/35] 10.222.0.23 () {54 vars in 927 bytes} [Fri Oct 28 19:00:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 19:00:21.271096 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d17f3a-0990-47e4-bfff-403a36837008 None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:00:21.294812 dv-cinder-862365-1-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 17/36] 10.222.0.23 () {60 vars in 1131 bytes} [Fri Oct 28 19:00:20 2022] POST /identity/v3/roles => generated 219 bytes in 349 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 19:00:21.296103 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c98a333-0d53-47e1-840b-9dc9c5e7cb10 None None] REQUEST_METHOD: `POST` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:00:21.296396 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c98a333-0d53-47e1-840b-9dc9c5e7cb10 None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:00:21.296677 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c98a333-0d53-47e1-840b-9dc9c5e7cb10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:00:21.325239 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.auth.core [None req-6c98a333-0d53-47e1-840b-9dc9c5e7cb10 None None] MFA Rules not processed for user `ae863915635746d1ac19970949de4722`. Rule list: `[]` (Enabled: `True`). {{(pid=81765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:00:21.327193 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-6c98a333-0d53-47e1-840b-9dc9c5e7cb10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:00:21.408433 dv-cinder-862365-1-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 18/37] 10.222.0.23 () {58 vars in 1024 bytes} [Fri Oct 28 19:00:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 28 19:00:21.409796 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c98a333-0d53-47e1-840b-9dc9c5e7cb10 None None] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:00:21.419221 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d17f3a-0990-47e4-bfff-403a36837008 None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:00:21.448388 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:00:21.497739 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59ee4e4-885e-4d5e-b2c6-264d74fe9e6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:00:21.497739 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59ee4e4-885e-4d5e-b2c6-264d74fe9e6d None admin] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:00:21.498580 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59ee4e4-885e-4d5e-b2c6-264d74fe9e6d None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:00:21.499077 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59ee4e4-885e-4d5e-b2c6-264d74fe9e6d None admin] PATH_INFO: `/v3/projects` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:00:21.499986 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d59ee4e4-885e-4d5e-b2c6-264d74fe9e6d None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:00:21.501712 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d59ee4e4-885e-4d5e-b2c6-264d74fe9e6d None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:00:21.569440 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c98a333-0d53-47e1-840b-9dc9c5e7cb10 None None] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:00:21.588693 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:00:21.606794 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baebb072-4a53-4c0d-af11-d8ddcbf5c11c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:00:21.607554 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baebb072-4a53-4c0d-af11-d8ddcbf5c11c None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:00:21.607798 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baebb072-4a53-4c0d-af11-d8ddcbf5c11c None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:00:21.608070 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baebb072-4a53-4c0d-af11-d8ddcbf5c11c None admin] PATH_INFO: `/v3/users/ae863915635746d1ac19970949de4722` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:00:21.609535 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baebb072-4a53-4c0d-af11-d8ddcbf5c11c None admin] RBAC: Authorizing `identity:get_user(user_id=ae863915635746d1ac19970949de4722)` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:00:21.611143 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baebb072-4a53-4c0d-af11-d8ddcbf5c11c None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:00:21.612715 dv-cinder-862365-1-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 19/38] 10.222.0.23 () {56 vars in 1177 bytes} [Fri Oct 28 19:00:21 2022] GET /identity/v3/users/ae863915635746d1ac19970949de4722 => generated 247 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:00:21.613938 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99673da-9c3d-4bfc-9f50-92072652168d None None] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:00:21.614161 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99673da-9c3d-4bfc-9f50-92072652168d None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:00:21.614437 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99673da-9c3d-4bfc-9f50-92072652168d None None] PATH_INFO: `/` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:00:21.618495 dv-cinder-862365-1-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 20/39] 10.222.0.23 () {54 vars in 927 bytes} [Fri Oct 28 19:00:21 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 19:00:21.619562 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99673da-9c3d-4bfc-9f50-92072652168d None None] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:00:21.628945 dv-cinder-862365-1-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 20/40] 10.222.0.23 () {60 vars in 1141 bytes} [Fri Oct 28 19:00:21 2022] POST /identity/v3/projects => generated 301 bytes in 358 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 19:00:21.630473 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0ba128-c5d8-402e-ad3b-a60ce59dc5ab None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:00:21.632430 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0ba128-c5d8-402e-ad3b-a60ce59dc5ab None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:00:21.632430 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0ba128-c5d8-402e-ad3b-a60ce59dc5ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:00:21.657081 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-6d0ba128-c5d8-402e-ad3b-a60ce59dc5ab None None] MFA Rules not processed for user `ae863915635746d1ac19970949de4722`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:00:21.659254 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-6d0ba128-c5d8-402e-ad3b-a60ce59dc5ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:00:21.742326 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99673da-9c3d-4bfc-9f50-92072652168d None None] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:00:21.753445 dv-cinder-862365-1-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 21/41] 10.222.0.23 () {58 vars in 1024 bytes} [Fri Oct 28 19:00:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 28 19:00:21.754318 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0ba128-c5d8-402e-ad3b-a60ce59dc5ab None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:00:21.779183 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5f4e0b-80b0-4b16-8ebc-1b8db29f0fdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:00:21.782296 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5f4e0b-80b0-4b16-8ebc-1b8db29f0fdf None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:00:21.782296 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5f4e0b-80b0-4b16-8ebc-1b8db29f0fdf None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:00:21.782296 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5f4e0b-80b0-4b16-8ebc-1b8db29f0fdf None admin] PATH_INFO: `/v3/domains/default` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:00:21.782296 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c5f4e0b-80b0-4b16-8ebc-1b8db29f0fdf None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:00:21.783100 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c5f4e0b-80b0-4b16-8ebc-1b8db29f0fdf None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:00:21.784715 dv-cinder-862365-1-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 21/42] 10.222.0.23 () {56 vars in 1108 bytes} [Fri Oct 28 19:00:21 2022] GET /identity/v3/domains/default => generated 199 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:00:21.790672 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5f4e0b-80b0-4b16-8ebc-1b8db29f0fdf None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:00:21.873760 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:00:21.928561 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5f4e0b-80b0-4b16-8ebc-1b8db29f0fdf None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:00:21.963984 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a3c280-a0fa-4e75-a9cd-7db3e2831f5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:00:21.964644 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a3c280-a0fa-4e75-a9cd-7db3e2831f5d None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:00:21.965460 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a3c280-a0fa-4e75-a9cd-7db3e2831f5d None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:00:21.965740 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a3c280-a0fa-4e75-a9cd-7db3e2831f5d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:00:21.966491 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a3c280-a0fa-4e75-a9cd-7db3e2831f5d None admin] RBAC: Adding query filter params (role.id=a9e4e47c2bf448fcbada91c1174644f7, scope.domain.id=default, user.id=ae863915635746d1ac19970949de4722) {{(pid=81765) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:00:21.966783 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a3c280-a0fa-4e75-a9cd-7db3e2831f5d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:00:21.968325 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a3c280-a0fa-4e75-a9cd-7db3e2831f5d None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:00:21.977241 dv-cinder-862365-1-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 22/43] 10.222.0.23 () {56 vars in 1322 bytes} [Fri Oct 28 19:00:21 2022] GET /identity/v3/role_assignments?user.id=ae863915635746d1ac19970949de4722&scope.domain.id=default&role.id=a9e4e47c2bf448fcbada91c1174644f7 => generated 530 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 19:00:21.992876 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:00:22.001464 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0ba128-c5d8-402e-ad3b-a60ce59dc5ab None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:00:22.026984 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a3c280-a0fa-4e75-a9cd-7db3e2831f5d None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:00:22.042123 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a53ebe6-1c8f-4c82-90fd-4be15b0f4c3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:00:22.043741 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a53ebe6-1c8f-4c82-90fd-4be15b0f4c3d None admin] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:00:22.043741 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a53ebe6-1c8f-4c82-90fd-4be15b0f4c3d None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:00:22.044054 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a53ebe6-1c8f-4c82-90fd-4be15b0f4c3d None admin] PATH_INFO: `/v3/roles` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:00:22.044901 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a53ebe6-1c8f-4c82-90fd-4be15b0f4c3d None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:00:22.046522 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a53ebe6-1c8f-4c82-90fd-4be15b0f4c3d None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:00:22.135287 dv-cinder-862365-1-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 22/44] 10.222.0.23 () {60 vars in 1131 bytes} [Fri Oct 28 19:00:21 2022] POST /identity/v3/roles => generated 223 bytes in 381 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 19:00:22.136105 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a3c280-a0fa-4e75-a9cd-7db3e2831f5d None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:00:22.161269 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:00:22.188664 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d06ecf7-f2fd-487f-a197-2dd7f620723b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:00:22.189247 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d06ecf7-f2fd-487f-a197-2dd7f620723b None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:00:22.189643 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d06ecf7-f2fd-487f-a197-2dd7f620723b None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:00:22.189927 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d06ecf7-f2fd-487f-a197-2dd7f620723b None admin] PATH_INFO: `/v3/domains/default` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:00:22.191179 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d06ecf7-f2fd-487f-a197-2dd7f620723b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:00:22.192685 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d06ecf7-f2fd-487f-a197-2dd7f620723b None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:00:22.194505 dv-cinder-862365-1-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 23/45] 10.222.0.23 () {56 vars in 1108 bytes} [Fri Oct 28 19:00:22 2022] GET /identity/v3/domains/default => generated 199 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:00:22.201012 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a53ebe6-1c8f-4c82-90fd-4be15b0f4c3d None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:00:22.313564 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a53ebe6-1c8f-4c82-90fd-4be15b0f4c3d None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:00:22.348011 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e413156c-85a5-47f4-8678-3d58314b37a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:00:22.348626 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e413156c-85a5-47f4-8678-3d58314b37a0 None admin] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:00:22.348918 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e413156c-85a5-47f4-8678-3d58314b37a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:00:22.349196 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e413156c-85a5-47f4-8678-3d58314b37a0 None admin] PATH_INFO: `/v3/projects` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:00:22.349928 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e413156c-85a5-47f4-8678-3d58314b37a0 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:00:22.351381 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e413156c-85a5-47f4-8678-3d58314b37a0 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:00:22.432415 dv-cinder-862365-1-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 23/46] 10.222.0.23 () {60 vars in 1141 bytes} [Fri Oct 28 19:00:22 2022] POST /identity/v3/projects => generated 312 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 19:00:24.550957 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f870bd4d-aba6-4546-acd3-1f58727b5465 None None] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:00:24.551472 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f870bd4d-aba6-4546-acd3-1f58727b5465 None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:00:24.551557 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f870bd4d-aba6-4546-acd3-1f58727b5465 None None] PATH_INFO: `/` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:00:24.552890 dv-cinder-862365-1-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 24/47] 10.222.0.23 () {54 vars in 927 bytes} [Fri Oct 28 19:00:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 19:00:24.557982 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aff39ef-3489-4d48-b329-317922ca3dab None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:00:24.559062 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aff39ef-3489-4d48-b329-317922ca3dab None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:00:24.559345 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aff39ef-3489-4d48-b329-317922ca3dab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:00:24.571446 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:00:24.577795 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-5aff39ef-3489-4d48-b329-317922ca3dab None None] MFA Rules not processed for user `ae863915635746d1ac19970949de4722`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:00:24.578969 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-5aff39ef-3489-4d48-b329-317922ca3dab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:00:24.642105 dv-cinder-862365-1-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 24/48] 10.222.0.23 () {58 vars in 1024 bytes} [Fri Oct 28 19:00:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 28 19:00:24.911771 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f870bd4d-aba6-4546-acd3-1f58727b5465 None None] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:00:25.013977 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f870bd4d-aba6-4546-acd3-1f58727b5465 None None] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:00:25.046802 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc98a32-ca87-4d94-9735-5ee8082b2da0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:00:25.047430 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc98a32-ca87-4d94-9735-5ee8082b2da0 None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:00:25.047715 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc98a32-ca87-4d94-9735-5ee8082b2da0 None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:00:25.047991 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc98a32-ca87-4d94-9735-5ee8082b2da0 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:00:25.049098 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc98a32-ca87-4d94-9735-5ee8082b2da0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:00:25.050591 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc98a32-ca87-4d94-9735-5ee8082b2da0 None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:00:25.052151 dv-cinder-862365-1-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 25/49] 10.222.0.23 () {56 vars in 1108 bytes} [Fri Oct 28 19:00:24 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:00:25.057795 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aff39ef-3489-4d48-b329-317922ca3dab None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:00:25.152498 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aff39ef-3489-4d48-b329-317922ca3dab None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:00:25.185545 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83d6d64-2c47-4583-89e5-ab1c1f5aacad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:00:25.186146 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83d6d64-2c47-4583-89e5-ab1c1f5aacad None admin] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:00:25.186430 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83d6d64-2c47-4583-89e5-ab1c1f5aacad None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:00:25.186714 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83d6d64-2c47-4583-89e5-ab1c1f5aacad None admin] PATH_INFO: `/v3/projects` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:00:25.187358 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83d6d64-2c47-4583-89e5-ab1c1f5aacad None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:00:25.188806 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83d6d64-2c47-4583-89e5-ab1c1f5aacad None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:00:25.193991 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:00:25.288031 dv-cinder-862365-1-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 25/50] 10.222.0.23 () {60 vars in 1140 bytes} [Fri Oct 28 19:00:25 2022] POST /identity/v3/projects => generated 298 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 19:00:27.447086 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d57255-c2d6-43e5-aedc-fc159dd8d5ec None None] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:00:27.447604 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d57255-c2d6-43e5-aedc-fc159dd8d5ec None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:00:27.447715 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d57255-c2d6-43e5-aedc-fc159dd8d5ec None None] PATH_INFO: `/` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:00:27.449559 dv-cinder-862365-1-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 26/51] 10.222.0.23 () {54 vars in 927 bytes} [Fri Oct 28 19:00:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 19:00:27.454698 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1975ba2d-12b3-40b0-8e69-89525b2642c0 None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:00:27.455119 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1975ba2d-12b3-40b0-8e69-89525b2642c0 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:00:27.455294 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1975ba2d-12b3-40b0-8e69-89525b2642c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:00:27.473927 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-1975ba2d-12b3-40b0-8e69-89525b2642c0 None None] MFA Rules not processed for user `ae863915635746d1ac19970949de4722`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:00:27.475119 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-1975ba2d-12b3-40b0-8e69-89525b2642c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:00:27.539787 dv-cinder-862365-1-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 26/52] 10.222.0.23 () {58 vars in 1024 bytes} [Fri Oct 28 19:00:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 28 19:00:27.807908 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d57255-c2d6-43e5-aedc-fc159dd8d5ec None None] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:00:27.859227 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:00:27.910412 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d57255-c2d6-43e5-aedc-fc159dd8d5ec None None] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:00:27.942866 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169d83f6-ebb8-48e3-a01a-d438cdaec005 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:00:27.943491 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169d83f6-ebb8-48e3-a01a-d438cdaec005 None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:00:27.943779 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169d83f6-ebb8-48e3-a01a-d438cdaec005 None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:00:27.944062 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169d83f6-ebb8-48e3-a01a-d438cdaec005 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:00:27.945182 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169d83f6-ebb8-48e3-a01a-d438cdaec005 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:00:27.946681 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169d83f6-ebb8-48e3-a01a-d438cdaec005 None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:00:27.948259 dv-cinder-862365-1-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 27/53] 10.222.0.23 () {56 vars in 1108 bytes} [Fri Oct 28 19:00:27 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:00:27.955090 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1975ba2d-12b3-40b0-8e69-89525b2642c0 None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:00:28.051731 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1975ba2d-12b3-40b0-8e69-89525b2642c0 None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:00:28.074625 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:00:28.084747 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c242d7-fc0f-499e-8c4b-d1eff33519ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:00:28.085639 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c242d7-fc0f-499e-8c4b-d1eff33519ef None admin] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:00:28.085926 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c242d7-fc0f-499e-8c4b-d1eff33519ef None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:00:28.086204 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c242d7-fc0f-499e-8c4b-d1eff33519ef None admin] PATH_INFO: `/v3/users` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:00:28.086861 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c242d7-fc0f-499e-8c4b-d1eff33519ef None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:00:28.088308 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c242d7-fc0f-499e-8c4b-d1eff33519ef None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:00:28.207992 dv-cinder-862365-1-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 27/54] 10.222.0.23 () {60 vars in 1132 bytes} [Fri Oct 28 19:00:27 2022] POST /identity/v3/users => generated 275 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 19:00:31.506902 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac26118-80b6-4a30-bb19-524ec0625af0 None None] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:00:31.507779 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac26118-80b6-4a30-bb19-524ec0625af0 None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:00:31.508205 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac26118-80b6-4a30-bb19-524ec0625af0 None None] PATH_INFO: `/` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:00:31.510146 dv-cinder-862365-1-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 28/55] 10.222.0.23 () {54 vars in 927 bytes} [Fri Oct 28 19:00:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 19:00:31.517018 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c2c003-70d2-497b-a20b-64184e9984a9 None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:00:31.517940 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c2c003-70d2-497b-a20b-64184e9984a9 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:00:31.518373 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c2c003-70d2-497b-a20b-64184e9984a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:00:31.550378 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-24c2c003-70d2-497b-a20b-64184e9984a9 None None] MFA Rules not processed for user `ae863915635746d1ac19970949de4722`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:00:31.551849 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-24c2c003-70d2-497b-a20b-64184e9984a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:00:31.651620 dv-cinder-862365-1-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 28/56] 10.222.0.23 () {58 vars in 1024 bytes} [Fri Oct 28 19:00:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 28 19:00:31.672519 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e095bd-d37f-4432-90b6-c22f5e72ad04 None None] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:00:31.673026 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e095bd-d37f-4432-90b6-c22f5e72ad04 None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:00:31.673475 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e095bd-d37f-4432-90b6-c22f5e72ad04 None None] PATH_INFO: `/` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:00:31.674945 dv-cinder-862365-1-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 29/57] 10.222.0.23 () {54 vars in 927 bytes} [Fri Oct 28 19:00:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 19:00:31.680272 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fded708e-e03a-4f70-9b2a-7376528c5fa4 None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:00:31.680745 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fded708e-e03a-4f70-9b2a-7376528c5fa4 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:00:31.681179 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fded708e-e03a-4f70-9b2a-7376528c5fa4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:00:31.690412 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f12485-4088-42e5-a1de-71be956c8887 None None] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:00:31.690412 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f12485-4088-42e5-a1de-71be956c8887 None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:00:31.690412 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f12485-4088-42e5-a1de-71be956c8887 None None] PATH_INFO: `/` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:00:31.690412 dv-cinder-862365-1-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 30/58] 10.222.0.23 () {54 vars in 927 bytes} [Fri Oct 28 19:00:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 19:00:31.703241 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-fded708e-e03a-4f70-9b2a-7376528c5fa4 None None] MFA Rules not processed for user `ae863915635746d1ac19970949de4722`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:00:31.704021 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dffa178-4912-4520-9419-07a020252efb None None] REQUEST_METHOD: `POST` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:00:31.704429 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-fded708e-e03a-4f70-9b2a-7376528c5fa4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:00:31.704590 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dffa178-4912-4520-9419-07a020252efb None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:00:31.705000 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dffa178-4912-4520-9419-07a020252efb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:00:31.734527 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.auth.core [None req-3dffa178-4912-4520-9419-07a020252efb None None] MFA Rules not processed for user `ae863915635746d1ac19970949de4722`. Rule list: `[]` (Enabled: `True`). {{(pid=81765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:00:31.735731 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-3dffa178-4912-4520-9419-07a020252efb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:00:31.826406 dv-cinder-862365-1-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 29/59] 10.222.0.23 () {58 vars in 1024 bytes} [Fri Oct 28 19:00:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 28 19:00:31.863374 dv-cinder-862365-1-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 31/60] 10.222.0.23 () {58 vars in 1024 bytes} [Fri Oct 28 19:00:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 28 19:00:31.946413 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2216914-8099-45ea-9aa5-aa1e56974789 None None] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:00:31.946700 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2216914-8099-45ea-9aa5-aa1e56974789 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:00:31.947147 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2216914-8099-45ea-9aa5-aa1e56974789 None None] PATH_INFO: `/` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:00:31.949446 dv-cinder-862365-1-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 30/61] 10.222.0.23 () {54 vars in 927 bytes} [Fri Oct 28 19:00:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 19:00:31.954652 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0a59a7-bf17-4c19-8fb3-e4f4ad39a27f None None] REQUEST_METHOD: `POST` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:00:31.955093 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0a59a7-bf17-4c19-8fb3-e4f4ad39a27f None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:00:31.955537 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0a59a7-bf17-4c19-8fb3-e4f4ad39a27f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:00:31.977037 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.auth.core [None req-fd0a59a7-bf17-4c19-8fb3-e4f4ad39a27f None None] MFA Rules not processed for user `ae863915635746d1ac19970949de4722`. Rule list: `[]` (Enabled: `True`). {{(pid=81765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:00:31.978459 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-fd0a59a7-bf17-4c19-8fb3-e4f4ad39a27f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:00:32.021765 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2216914-8099-45ea-9aa5-aa1e56974789 None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:00:32.033304 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:00:32.065704 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:00:32.082488 dv-cinder-862365-1-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 32/62] 10.222.0.23 () {58 vars in 1024 bytes} [Fri Oct 28 19:00:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 28 19:00:32.159576 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2216914-8099-45ea-9aa5-aa1e56974789 None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:00:32.161097 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0a59a7-bf17-4c19-8fb3-e4f4ad39a27f None None] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:00:32.201123 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa7f611-4a7c-46c7-8eec-4b06fd310883 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:00:32.202143 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa7f611-4a7c-46c7-8eec-4b06fd310883 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:00:32.202620 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa7f611-4a7c-46c7-8eec-4b06fd310883 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:00:32.203087 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa7f611-4a7c-46c7-8eec-4b06fd310883 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:00:32.216143 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa7f611-4a7c-46c7-8eec-4b06fd310883 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 19:00:32.221700 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application [None req-dfa7f611-4a7c-46c7-8eec-4b06fd310883 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 28 19:00:32.221700 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 19:00:32.221700 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 19:00:32.221700 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 19:00:32.221700 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 19:00:32.221700 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 19:00:32.221700 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 19:00:32.221700 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 19:00:32.221700 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 19:00:32.221700 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 19:00:32.221700 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 19:00:32.221700 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 19:00:32.221700 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 28 19:00:32.221700 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 28 19:00:32.221700 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 28 19:00:32.221700 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 28 19:00:32.222540 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 28 19:00:32.222540 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 28 19:00:32.222540 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 28 19:00:32.222540 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 28 19:00:32.222540 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 19:00:32.222540 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 19:00:32.222540 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 19:00:32.222540 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 19:00:32.222540 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 19:00:32.222540 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 19:00:32.222540 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 19:00:32.222540 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application with Lock( Oct 28 19:00:32.222540 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 19:00:32.222540 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._enter() Oct 28 19:00:32.222540 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 19:00:32.222540 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 19:00:32.223308 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 19:00:32.223308 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.creator() Oct 28 19:00:32.223308 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 19:00:32.223308 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application created_value = creator( Oct 28 19:00:32.223308 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 28 19:00:32.223308 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 28 19:00:32.223308 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 28 19:00:32.223308 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 28 19:00:32.223308 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 28 19:00:32.223308 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 28 19:00:32.223308 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 28 19:00:32.223308 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Oct 28 19:00:32.225618 dv-cinder-862365-1-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 31/63] 10.222.0.23 () {56 vars in 1099 bytes} [Fri Oct 28 19:00:32 2022] GET /identity/v3/roles/member => generated 84 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 19:00:32.231619 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa7f611-4a7c-46c7-8eec-4b06fd310883 None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:00:32.309147 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0a59a7-bf17-4c19-8fb3-e4f4ad39a27f None None] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:00:32.334875 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:00:32.342219 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa7f611-4a7c-46c7-8eec-4b06fd310883 None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:00:32.381775 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab1e289-302b-4bf6-b59d-d3405e663986 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:00:32.382403 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab1e289-302b-4bf6-b59d-d3405e663986 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:00:32.382687 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab1e289-302b-4bf6-b59d-d3405e663986 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:00:32.382965 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab1e289-302b-4bf6-b59d-d3405e663986 None admin] PATH_INFO: `/v3/roles` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:00:32.383646 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab1e289-302b-4bf6-b59d-d3405e663986 None admin] RBAC: Adding query filter params (name=member) {{(pid=81766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:00:32.383961 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab1e289-302b-4bf6-b59d-d3405e663986 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:00:32.385414 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab1e289-302b-4bf6-b59d-d3405e663986 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:00:32.394559 dv-cinder-862365-1-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 32/64] 10.222.0.23 () {56 vars in 1101 bytes} [Fri Oct 28 19:00:32 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 19:00:32.399818 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e551883e-4a32-4844-bef2-ee098b2cc060 None None] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:00:32.399818 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e551883e-4a32-4844-bef2-ee098b2cc060 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:00:32.399818 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e551883e-4a32-4844-bef2-ee098b2cc060 None None] PATH_INFO: `/` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:00:32.399818 dv-cinder-862365-1-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 33/65] 10.222.0.23 () {54 vars in 927 bytes} [Fri Oct 28 19:00:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 19:00:32.399818 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e551883e-4a32-4844-bef2-ee098b2cc060 None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:00:32.449224 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ffd599e-81e2-4473-88cc-fcd2ceaabc9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:00:32.449884 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffd599e-81e2-4473-88cc-fcd2ceaabc9c None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:00:32.450167 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffd599e-81e2-4473-88cc-fcd2ceaabc9c None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:00:32.450439 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffd599e-81e2-4473-88cc-fcd2ceaabc9c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:00:32.460709 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ffd599e-81e2-4473-88cc-fcd2ceaabc9c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 19:00:32.466361 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application [None req-7ffd599e-81e2-4473-88cc-fcd2ceaabc9c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 28 19:00:32.466361 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 19:00:32.466361 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 19:00:32.466361 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 19:00:32.466361 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 19:00:32.466361 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 19:00:32.466361 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 19:00:32.466361 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 19:00:32.466361 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 19:00:32.466361 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 19:00:32.466361 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 19:00:32.466361 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 19:00:32.466361 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 28 19:00:32.466361 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 28 19:00:32.466361 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 28 19:00:32.466361 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 28 19:00:32.467320 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 28 19:00:32.467320 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 28 19:00:32.467320 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 28 19:00:32.467320 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 28 19:00:32.467320 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 19:00:32.467320 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 19:00:32.467320 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 19:00:32.467320 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 19:00:32.467320 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 19:00:32.467320 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 19:00:32.467320 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 19:00:32.467320 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application with Lock( Oct 28 19:00:32.467320 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 19:00:32.467320 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._enter() Oct 28 19:00:32.467320 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 19:00:32.467320 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 19:00:32.468094 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 19:00:32.468094 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.creator() Oct 28 19:00:32.468094 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 19:00:32.468094 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application created_value = creator( Oct 28 19:00:32.468094 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 28 19:00:32.468094 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 28 19:00:32.468094 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 28 19:00:32.468094 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 28 19:00:32.468094 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 28 19:00:32.468094 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 28 19:00:32.468094 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 28 19:00:32.468094 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application Oct 28 19:00:32.468094 dv-cinder-862365-1-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 33/66] 10.222.0.23 () {56 vars in 1096 bytes} [Fri Oct 28 19:00:32 2022] GET /identity/v3/roles/admin => generated 83 bytes in 307 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 28 19:00:32.468714 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ffd599e-81e2-4473-88cc-fcd2ceaabc9c None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:00:32.502790 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e551883e-4a32-4844-bef2-ee098b2cc060 None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:00:32.503914 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:00:32.535523 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd4a56b-bb42-4898-8a0d-9ca39d0583f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:00:32.536199 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd4a56b-bb42-4898-8a0d-9ca39d0583f8 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:00:32.536484 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd4a56b-bb42-4898-8a0d-9ca39d0583f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:00:32.536764 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd4a56b-bb42-4898-8a0d-9ca39d0583f8 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:00:32.547070 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd4a56b-bb42-4898-8a0d-9ca39d0583f8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 19:00:32.552325 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application [None req-3fd4a56b-bb42-4898-8a0d-9ca39d0583f8 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 28 19:00:32.552325 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 19:00:32.552325 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 19:00:32.552325 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 19:00:32.552325 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 19:00:32.552325 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 19:00:32.552325 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 19:00:32.552325 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 19:00:32.552325 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 19:00:32.552325 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 19:00:32.552325 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 19:00:32.552325 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 19:00:32.552325 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 28 19:00:32.552325 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 28 19:00:32.552325 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 28 19:00:32.552325 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 28 19:00:32.553287 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 28 19:00:32.553287 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 28 19:00:32.553287 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 28 19:00:32.553287 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 28 19:00:32.553287 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 19:00:32.553287 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 19:00:32.553287 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 19:00:32.553287 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 19:00:32.553287 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 19:00:32.553287 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 19:00:32.553287 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 19:00:32.553287 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application with Lock( Oct 28 19:00:32.553287 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 19:00:32.553287 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._enter() Oct 28 19:00:32.553287 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 19:00:32.553287 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 19:00:32.554264 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 19:00:32.554264 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.creator() Oct 28 19:00:32.554264 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 19:00:32.554264 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application created_value = creator( Oct 28 19:00:32.554264 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 28 19:00:32.554264 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 28 19:00:32.554264 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 28 19:00:32.554264 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 28 19:00:32.554264 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 28 19:00:32.554264 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 28 19:00:32.554264 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 28 19:00:32.554264 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Oct 28 19:00:32.554264 dv-cinder-862365-1-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 34/67] 10.222.0.23 () {56 vars in 1114 bytes} [Fri Oct 28 19:00:32 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 19:00:32.554264 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd4a56b-bb42-4898-8a0d-9ca39d0583f8 None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:00:32.571677 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ffd599e-81e2-4473-88cc-fcd2ceaabc9c None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:00:32.572141 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:00:32.606352 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d404cb-8ea5-45a0-88e1-a7861e7b7b94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:00:32.606908 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d404cb-8ea5-45a0-88e1-a7861e7b7b94 None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:00:32.607190 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d404cb-8ea5-45a0-88e1-a7861e7b7b94 None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:00:32.607471 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d404cb-8ea5-45a0-88e1-a7861e7b7b94 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:00:32.617503 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d404cb-8ea5-45a0-88e1-a7861e7b7b94 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 19:00:32.622862 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application [None req-a9d404cb-8ea5-45a0-88e1-a7861e7b7b94 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 28 19:00:32.622862 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 19:00:32.622862 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 19:00:32.622862 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 19:00:32.622862 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 19:00:32.622862 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 19:00:32.622862 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 19:00:32.622862 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 19:00:32.622862 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 19:00:32.622862 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 19:00:32.622862 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 19:00:32.622862 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 19:00:32.622862 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 28 19:00:32.622862 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 28 19:00:32.622862 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 28 19:00:32.622862 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 28 19:00:32.623771 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 28 19:00:32.623771 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 28 19:00:32.623771 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 28 19:00:32.623771 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 28 19:00:32.623771 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 19:00:32.623771 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 19:00:32.623771 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 19:00:32.623771 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 19:00:32.623771 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 19:00:32.623771 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 19:00:32.623771 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 19:00:32.623771 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application with Lock( Oct 28 19:00:32.623771 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 19:00:32.623771 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._enter() Oct 28 19:00:32.623771 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 19:00:32.623771 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 19:00:32.624520 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 19:00:32.624520 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.creator() Oct 28 19:00:32.624520 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 19:00:32.624520 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application created_value = creator( Oct 28 19:00:32.624520 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 28 19:00:32.624520 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 28 19:00:32.624520 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 28 19:00:32.624520 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 28 19:00:32.624520 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 28 19:00:32.624520 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 28 19:00:32.624520 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 28 19:00:32.624520 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application Oct 28 19:00:32.624520 dv-cinder-862365-1-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 34/68] 10.222.0.23 () {56 vars in 1099 bytes} [Fri Oct 28 19:00:32 2022] GET /identity/v3/roles/member => generated 84 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 19:00:32.625589 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798b2210-39a7-4dd2-8480-47951b4af026 None None] REQUEST_METHOD: `POST` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:00:32.625877 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798b2210-39a7-4dd2-8480-47951b4af026 None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:00:32.626155 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798b2210-39a7-4dd2-8480-47951b4af026 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:00:32.643251 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.auth.core [None req-798b2210-39a7-4dd2-8480-47951b4af026 None None] MFA Rules not processed for user `ae863915635746d1ac19970949de4722`. Rule list: `[]` (Enabled: `True`). {{(pid=81765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:00:32.644444 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-798b2210-39a7-4dd2-8480-47951b4af026 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:00:32.656020 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd4a56b-bb42-4898-8a0d-9ca39d0583f8 None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:00:32.691332 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec33409-8394-4a3d-bedd-5418568b7e1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:00:32.691954 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec33409-8394-4a3d-bedd-5418568b7e1b None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:00:32.692234 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec33409-8394-4a3d-bedd-5418568b7e1b None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:00:32.692508 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec33409-8394-4a3d-bedd-5418568b7e1b None admin] PATH_INFO: `/v3/users/154626d9963c47efa7bf7e5dd699ae08` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:00:32.705410 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec33409-8394-4a3d-bedd-5418568b7e1b None admin] RBAC: Authorizing `identity:get_user(user_id=154626d9963c47efa7bf7e5dd699ae08)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:00:32.706943 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec33409-8394-4a3d-bedd-5418568b7e1b None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:00:32.708744 dv-cinder-862365-1-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 35/69] 10.222.0.23 () {56 vars in 1177 bytes} [Fri Oct 28 19:00:32 2022] GET /identity/v3/users/154626d9963c47efa7bf7e5dd699ae08 => generated 275 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:00:32.709457 dv-cinder-862365-1-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 35/70] 10.222.0.23 () {58 vars in 1024 bytes} [Fri Oct 28 19:00:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 28 19:00:32.709735 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec33409-8394-4a3d-bedd-5418568b7e1b None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:00:32.710616 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798b2210-39a7-4dd2-8480-47951b4af026 None None] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:00:32.740973 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:00:32.787880 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:00:32.814004 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec33409-8394-4a3d-bedd-5418568b7e1b None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:00:32.815048 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798b2210-39a7-4dd2-8480-47951b4af026 None None] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:00:32.850713 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f68ac0-081e-4150-8cac-343e698d380b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:00:32.851334 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f68ac0-081e-4150-8cac-343e698d380b None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:00:32.851621 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f68ac0-081e-4150-8cac-343e698d380b None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:00:32.851906 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f68ac0-081e-4150-8cac-343e698d380b None admin] PATH_INFO: `/v3/roles` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:00:32.852576 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f68ac0-081e-4150-8cac-343e698d380b None admin] RBAC: Adding query filter params (name=admin) {{(pid=81766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:00:32.852885 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f68ac0-081e-4150-8cac-343e698d380b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:00:32.854302 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f68ac0-081e-4150-8cac-343e698d380b None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:00:32.855885 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c6210e-21a2-48bd-b0e3-df3d4e270f8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:00:32.856702 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c6210e-21a2-48bd-b0e3-df3d4e270f8a None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:00:32.857140 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c6210e-21a2-48bd-b0e3-df3d4e270f8a None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:00:32.857465 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c6210e-21a2-48bd-b0e3-df3d4e270f8a None admin] PATH_INFO: `/v3/roles` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:00:32.858176 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c6210e-21a2-48bd-b0e3-df3d4e270f8a None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81765) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:00:32.858489 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c6210e-21a2-48bd-b0e3-df3d4e270f8a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:00:32.859929 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c6210e-21a2-48bd-b0e3-df3d4e270f8a None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:00:32.863850 dv-cinder-862365-1-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 36/71] 10.222.0.23 () {56 vars in 1099 bytes} [Fri Oct 28 19:00:32 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:00:32.864863 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f68ac0-081e-4150-8cac-343e698d380b None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:00:32.872044 dv-cinder-862365-1-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 36/72] 10.222.0.23 () {56 vars in 1111 bytes} [Fri Oct 28 19:00:32 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:00:32.872044 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c6210e-21a2-48bd-b0e3-df3d4e270f8a None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:00:32.962784 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:00:32.976190 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c6210e-21a2-48bd-b0e3-df3d4e270f8a None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:00:32.976312 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f68ac0-081e-4150-8cac-343e698d380b None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:00:33.013224 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a255d6d-6b83-4e75-983d-4b61f9e5fc71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:00:33.013473 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd15bbdc-3ddc-4260-abfb-1d0ec8bce3b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:00:33.013768 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a255d6d-6b83-4e75-983d-4b61f9e5fc71 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:00:33.013957 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd15bbdc-3ddc-4260-abfb-1d0ec8bce3b8 None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:00:33.014046 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a255d6d-6b83-4e75-983d-4b61f9e5fc71 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:00:33.014240 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd15bbdc-3ddc-4260-abfb-1d0ec8bce3b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:00:33.014337 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a255d6d-6b83-4e75-983d-4b61f9e5fc71 None admin] PATH_INFO: `/v3/roles` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:00:33.014515 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd15bbdc-3ddc-4260-abfb-1d0ec8bce3b8 None admin] PATH_INFO: `/v3/projects/575e6206099b4a24bc9b829f3e7b6bdc` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:00:33.014973 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a255d6d-6b83-4e75-983d-4b61f9e5fc71 None admin] RBAC: Adding query filter params (name=member) {{(pid=81766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:00:33.015284 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a255d6d-6b83-4e75-983d-4b61f9e5fc71 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:00:33.015660 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd15bbdc-3ddc-4260-abfb-1d0ec8bce3b8 None admin] RBAC: Authorizing `identity:get_project(project_id=575e6206099b4a24bc9b829f3e7b6bdc)` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:00:33.016668 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a255d6d-6b83-4e75-983d-4b61f9e5fc71 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:00:33.017086 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd15bbdc-3ddc-4260-abfb-1d0ec8bce3b8 None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:00:33.018787 dv-cinder-862365-1-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 37/73] 10.222.0.23 () {56 vars in 1186 bytes} [Fri Oct 28 19:00:32 2022] GET /identity/v3/projects/575e6206099b4a24bc9b829f3e7b6bdc => generated 298 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:00:33.019029 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:00:33.019606 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd15bbdc-3ddc-4260-abfb-1d0ec8bce3b8 None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:00:33.031776 dv-cinder-862365-1-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 37/74] 10.222.0.23 () {56 vars in 1101 bytes} [Fri Oct 28 19:00:32 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:00:33.032617 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a255d6d-6b83-4e75-983d-4b61f9e5fc71 None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:00:33.124765 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd15bbdc-3ddc-4260-abfb-1d0ec8bce3b8 None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:00:33.141854 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a255d6d-6b83-4e75-983d-4b61f9e5fc71 None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:00:33.158735 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23c1274-ba93-4aa2-8c58-7cffe3b68090 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:00:33.159363 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23c1274-ba93-4aa2-8c58-7cffe3b68090 None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:00:33.159644 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23c1274-ba93-4aa2-8c58-7cffe3b68090 None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:00:33.159919 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23c1274-ba93-4aa2-8c58-7cffe3b68090 None admin] PATH_INFO: `/v3/users/ae863915635746d1ac19970949de4722` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:00:33.161077 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23c1274-ba93-4aa2-8c58-7cffe3b68090 None admin] RBAC: Authorizing `identity:get_user(user_id=ae863915635746d1ac19970949de4722)` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:00:33.162565 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23c1274-ba93-4aa2-8c58-7cffe3b68090 None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:00:33.164432 dv-cinder-862365-1-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 38/75] 10.222.0.23 () {56 vars in 1177 bytes} [Fri Oct 28 19:00:33 2022] GET /identity/v3/users/ae863915635746d1ac19970949de4722 => generated 247 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:00:33.164896 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23c1274-ba93-4aa2-8c58-7cffe3b68090 None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:00:33.177189 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984e4314-e829-4e5e-b601-ed569d5c1f7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:00:33.177856 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984e4314-e829-4e5e-b601-ed569d5c1f7c None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:00:33.178142 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984e4314-e829-4e5e-b601-ed569d5c1f7c None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:00:33.178420 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984e4314-e829-4e5e-b601-ed569d5c1f7c None admin] PATH_INFO: `/v3/users/154626d9963c47efa7bf7e5dd699ae08` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:00:33.179549 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984e4314-e829-4e5e-b601-ed569d5c1f7c None admin] RBAC: Authorizing `identity:get_user(user_id=154626d9963c47efa7bf7e5dd699ae08)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:00:33.181002 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984e4314-e829-4e5e-b601-ed569d5c1f7c None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:00:33.182612 dv-cinder-862365-1-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 38/76] 10.222.0.23 () {56 vars in 1177 bytes} [Fri Oct 28 19:00:33 2022] GET /identity/v3/users/154626d9963c47efa7bf7e5dd699ae08 => generated 275 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:00:33.183372 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984e4314-e829-4e5e-b601-ed569d5c1f7c None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:00:33.195271 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:00:33.246690 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:00:33.271557 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23c1274-ba93-4aa2-8c58-7cffe3b68090 None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:00:33.280731 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984e4314-e829-4e5e-b601-ed569d5c1f7c None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:00:33.305140 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e55645d-4349-4c18-9e67-8d95dbd7907f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:00:33.305804 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e55645d-4349-4c18-9e67-8d95dbd7907f None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:00:33.306089 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e55645d-4349-4c18-9e67-8d95dbd7907f None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:00:33.306365 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e55645d-4349-4c18-9e67-8d95dbd7907f None admin] PATH_INFO: `/v3/domains/default` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:00:33.307503 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e55645d-4349-4c18-9e67-8d95dbd7907f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:00:33.308963 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e55645d-4349-4c18-9e67-8d95dbd7907f None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:00:33.310578 dv-cinder-862365-1-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 39/77] 10.222.0.23 () {56 vars in 1108 bytes} [Fri Oct 28 19:00:33 2022] GET /identity/v3/domains/default => generated 199 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:00:33.311346 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e55645d-4349-4c18-9e67-8d95dbd7907f None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:00:33.314123 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddfe76cf-f33b-4ae1-8363-ce46540a6b86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:00:33.314781 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfe76cf-f33b-4ae1-8363-ce46540a6b86 None admin] REQUEST_METHOD: `PUT` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:00:33.315093 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfe76cf-f33b-4ae1-8363-ce46540a6b86 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:00:33.315340 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfe76cf-f33b-4ae1-8363-ce46540a6b86 None admin] PATH_INFO: `/v3/projects/575e6206099b4a24bc9b829f3e7b6bdc/users/154626d9963c47efa7bf7e5dd699ae08/roles/c193f661c7504bdf80c036f745eba59b` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:00:33.317246 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddfe76cf-f33b-4ae1-8363-ce46540a6b86 None admin] RBAC: Authorizing `identity:create_grant(project_id=575e6206099b4a24bc9b829f3e7b6bdc, user_id=154626d9963c47efa7bf7e5dd699ae08, role_id=c193f661c7504bdf80c036f745eba59b)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:00:33.318721 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddfe76cf-f33b-4ae1-8363-ce46540a6b86 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:00:33.400760 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:00:33.402546 dv-cinder-862365-1-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 39/78] 10.222.0.23 () {58 vars in 1439 bytes} [Fri Oct 28 19:00:33 2022] PUT /identity/v3/projects/575e6206099b4a24bc9b829f3e7b6bdc/users/154626d9963c47efa7bf7e5dd699ae08/roles/c193f661c7504bdf80c036f745eba59b => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 19:00:33.403482 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddfe76cf-f33b-4ae1-8363-ce46540a6b86 None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:00:33.411408 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e55645d-4349-4c18-9e67-8d95dbd7907f None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:00:33.455643 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a64950b-88fe-4f5d-b5ee-3c8aa30c73d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:00:33.456296 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a64950b-88fe-4f5d-b5ee-3c8aa30c73d2 None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:00:33.456666 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a64950b-88fe-4f5d-b5ee-3c8aa30c73d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:00:33.456941 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a64950b-88fe-4f5d-b5ee-3c8aa30c73d2 None admin] PATH_INFO: `/v3/users/154626d9963c47efa7bf7e5dd699ae08` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:00:33.458978 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a64950b-88fe-4f5d-b5ee-3c8aa30c73d2 None admin] RBAC: Authorizing `identity:get_user(user_id=154626d9963c47efa7bf7e5dd699ae08)` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:00:33.460826 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a64950b-88fe-4f5d-b5ee-3c8aa30c73d2 None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:00:33.467261 dv-cinder-862365-1-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 40/79] 10.222.0.23 () {56 vars in 1177 bytes} [Fri Oct 28 19:00:33 2022] GET /identity/v3/users/154626d9963c47efa7bf7e5dd699ae08 => generated 275 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:00:33.467261 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a64950b-88fe-4f5d-b5ee-3c8aa30c73d2 None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:00:33.522573 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddfe76cf-f33b-4ae1-8363-ce46540a6b86 None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:00:33.552464 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:00:33.564408 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d03663-43c2-4ce9-87ea-48008af95107 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:00:33.565062 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d03663-43c2-4ce9-87ea-48008af95107 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:00:33.565378 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d03663-43c2-4ce9-87ea-48008af95107 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:00:33.566166 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d03663-43c2-4ce9-87ea-48008af95107 None admin] PATH_INFO: `/v3/projects/575e6206099b4a24bc9b829f3e7b6bdc` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:00:33.567426 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d03663-43c2-4ce9-87ea-48008af95107 None admin] RBAC: Authorizing `identity:get_project(project_id=575e6206099b4a24bc9b829f3e7b6bdc)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:00:33.568892 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d03663-43c2-4ce9-87ea-48008af95107 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:00:33.570771 dv-cinder-862365-1-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 40/80] 10.222.0.23 () {56 vars in 1186 bytes} [Fri Oct 28 19:00:33 2022] GET /identity/v3/projects/575e6206099b4a24bc9b829f3e7b6bdc => generated 298 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:00:33.576680 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d03663-43c2-4ce9-87ea-48008af95107 None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:00:33.582202 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a64950b-88fe-4f5d-b5ee-3c8aa30c73d2 None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:00:33.618381 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9cafe9f-e325-42c4-bfbc-45091261c108 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:00:33.619030 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9cafe9f-e325-42c4-bfbc-45091261c108 None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:00:33.619319 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9cafe9f-e325-42c4-bfbc-45091261c108 None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:00:33.619601 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9cafe9f-e325-42c4-bfbc-45091261c108 None admin] PATH_INFO: `/v3/projects/575e6206099b4a24bc9b829f3e7b6bdc` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:00:33.621289 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9cafe9f-e325-42c4-bfbc-45091261c108 None admin] RBAC: Authorizing `identity:get_project(project_id=575e6206099b4a24bc9b829f3e7b6bdc)` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:00:33.622787 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9cafe9f-e325-42c4-bfbc-45091261c108 None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:00:33.624631 dv-cinder-862365-1-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 41/81] 10.222.0.23 () {56 vars in 1186 bytes} [Fri Oct 28 19:00:33 2022] GET /identity/v3/projects/575e6206099b4a24bc9b829f3e7b6bdc => generated 298 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:00:33.625328 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9cafe9f-e325-42c4-bfbc-45091261c108 None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:00:33.655890 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:00:33.689713 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d03663-43c2-4ce9-87ea-48008af95107 None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:00:33.724585 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8402683f-cc72-47ce-8628-6723b972dc26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:00:33.725197 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8402683f-cc72-47ce-8628-6723b972dc26 None admin] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:00:33.725521 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8402683f-cc72-47ce-8628-6723b972dc26 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:00:33.725801 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8402683f-cc72-47ce-8628-6723b972dc26 None admin] PATH_INFO: `/v3/users` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:00:33.726445 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8402683f-cc72-47ce-8628-6723b972dc26 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:00:33.727884 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8402683f-cc72-47ce-8628-6723b972dc26 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:00:33.738345 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9cafe9f-e325-42c4-bfbc-45091261c108 None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:00:33.772742 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70942c8-4fec-4394-80db-1278b73b5f9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:00:33.773390 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70942c8-4fec-4394-80db-1278b73b5f9a None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:00:33.773685 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70942c8-4fec-4394-80db-1278b73b5f9a None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:00:33.773960 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70942c8-4fec-4394-80db-1278b73b5f9a None admin] PATH_INFO: `/v3/projects/aa484ffa21624bd4a1402cbd4342aeba` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:00:33.775095 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b70942c8-4fec-4394-80db-1278b73b5f9a None admin] RBAC: Authorizing `identity:get_project(project_id=aa484ffa21624bd4a1402cbd4342aeba)` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:00:33.776542 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b70942c8-4fec-4394-80db-1278b73b5f9a None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:00:33.778736 dv-cinder-862365-1-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 42/82] 10.222.0.23 () {56 vars in 1186 bytes} [Fri Oct 28 19:00:33 2022] GET /identity/v3/projects/aa484ffa21624bd4a1402cbd4342aeba => generated 312 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:00:33.779478 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70942c8-4fec-4394-80db-1278b73b5f9a None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:00:33.797520 dv-cinder-862365-1-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 41/83] 10.222.0.23 () {60 vars in 1132 bytes} [Fri Oct 28 19:00:33 2022] POST /identity/v3/users => generated 289 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 19:00:33.798324 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8402683f-cc72-47ce-8628-6723b972dc26 None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:00:33.878385 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:00:33.915914 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:00:33.922519 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70942c8-4fec-4394-80db-1278b73b5f9a None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:00:33.965775 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f93f0b-0302-45be-a588-e1f97e1860d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:00:33.966459 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f93f0b-0302-45be-a588-e1f97e1860d8 None admin] REQUEST_METHOD: `PUT` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:00:33.966746 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f93f0b-0302-45be-a588-e1f97e1860d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:00:33.967027 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f93f0b-0302-45be-a588-e1f97e1860d8 None admin] PATH_INFO: `/v3/projects/575e6206099b4a24bc9b829f3e7b6bdc/users/ae863915635746d1ac19970949de4722/roles/a9e4e47c2bf448fcbada91c1174644f7` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:00:33.967811 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8402683f-cc72-47ce-8628-6723b972dc26 None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:00:33.968991 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f93f0b-0302-45be-a588-e1f97e1860d8 None admin] RBAC: Authorizing `identity:create_grant(project_id=575e6206099b4a24bc9b829f3e7b6bdc, user_id=ae863915635746d1ac19970949de4722, role_id=a9e4e47c2bf448fcbada91c1174644f7)` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:00:33.970672 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f93f0b-0302-45be-a588-e1f97e1860d8 None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:00:34.008929 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74212c78-6812-4fd2-847b-0a5534ece901 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:00:34.010271 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74212c78-6812-4fd2-847b-0a5534ece901 None admin] REQUEST_METHOD: `PUT` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:00:34.010271 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74212c78-6812-4fd2-847b-0a5534ece901 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:00:34.010271 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74212c78-6812-4fd2-847b-0a5534ece901 None admin] PATH_INFO: `/v3/projects/575e6206099b4a24bc9b829f3e7b6bdc/users/154626d9963c47efa7bf7e5dd699ae08/roles/a11a1b300fe044b5a905284bc623dc41` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:00:34.014890 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74212c78-6812-4fd2-847b-0a5534ece901 None admin] RBAC: Authorizing `identity:create_grant(project_id=575e6206099b4a24bc9b829f3e7b6bdc, user_id=154626d9963c47efa7bf7e5dd699ae08, role_id=a11a1b300fe044b5a905284bc623dc41)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:00:34.015624 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74212c78-6812-4fd2-847b-0a5534ece901 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:00:34.060672 dv-cinder-862365-1-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 43/84] 10.222.0.23 () {58 vars in 1439 bytes} [Fri Oct 28 19:00:33 2022] PUT /identity/v3/projects/575e6206099b4a24bc9b829f3e7b6bdc/users/ae863915635746d1ac19970949de4722/roles/a9e4e47c2bf448fcbada91c1174644f7 => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 19:00:34.061546 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f93f0b-0302-45be-a588-e1f97e1860d8 None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:00:34.083385 dv-cinder-862365-1-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 42/85] 10.222.0.23 () {58 vars in 1439 bytes} [Fri Oct 28 19:00:33 2022] PUT /identity/v3/projects/575e6206099b4a24bc9b829f3e7b6bdc/users/154626d9963c47efa7bf7e5dd699ae08/roles/a11a1b300fe044b5a905284bc623dc41 => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 19:00:34.198181 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f93f0b-0302-45be-a588-e1f97e1860d8 None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:00:34.247415 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478b7ed4-2b48-4427-90f4-391761a83365 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:00:34.248124 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478b7ed4-2b48-4427-90f4-391761a83365 None admin] REQUEST_METHOD: `PUT` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:00:34.248405 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478b7ed4-2b48-4427-90f4-391761a83365 None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:00:34.248686 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478b7ed4-2b48-4427-90f4-391761a83365 None admin] PATH_INFO: `/v3/projects/aa484ffa21624bd4a1402cbd4342aeba/users/154626d9963c47efa7bf7e5dd699ae08/roles/c193f661c7504bdf80c036f745eba59b` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:00:34.250904 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-478b7ed4-2b48-4427-90f4-391761a83365 None admin] RBAC: Authorizing `identity:create_grant(project_id=aa484ffa21624bd4a1402cbd4342aeba, user_id=154626d9963c47efa7bf7e5dd699ae08, role_id=c193f661c7504bdf80c036f745eba59b)` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:00:34.252418 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-478b7ed4-2b48-4427-90f4-391761a83365 None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:00:34.322798 dv-cinder-862365-1-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 44/86] 10.222.0.23 () {58 vars in 1439 bytes} [Fri Oct 28 19:00:34 2022] PUT /identity/v3/projects/aa484ffa21624bd4a1402cbd4342aeba/users/154626d9963c47efa7bf7e5dd699ae08/roles/c193f661c7504bdf80c036f745eba59b => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 19:00:36.037787 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2be58fe-f4c5-4697-a6b9-feef170e2923 None None] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:00:36.038284 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2be58fe-f4c5-4697-a6b9-feef170e2923 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:00:36.038381 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2be58fe-f4c5-4697-a6b9-feef170e2923 None None] PATH_INFO: `/` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:00:36.039916 dv-cinder-862365-1-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 43/87] 10.222.0.23 () {54 vars in 927 bytes} [Fri Oct 28 19:00:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 19:00:36.046102 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d47245-c7e5-4944-aa86-da8bcfd3881f None None] REQUEST_METHOD: `POST` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:00:36.046498 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d47245-c7e5-4944-aa86-da8bcfd3881f None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:00:36.046665 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d47245-c7e5-4944-aa86-da8bcfd3881f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:00:36.071279 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.auth.core [None req-67d47245-c7e5-4944-aa86-da8bcfd3881f None None] MFA Rules not processed for user `ae863915635746d1ac19970949de4722`. Rule list: `[]` (Enabled: `True`). {{(pid=81765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:00:36.072463 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-67d47245-c7e5-4944-aa86-da8bcfd3881f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:00:36.084061 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:00:36.151484 dv-cinder-862365-1-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 45/88] 10.222.0.23 () {58 vars in 1024 bytes} [Fri Oct 28 19:00:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 28 19:00:36.564922 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2be58fe-f4c5-4697-a6b9-feef170e2923 None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:00:36.679852 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2be58fe-f4c5-4697-a6b9-feef170e2923 None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:00:36.690579 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:00:36.714883 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1011b4-d88c-4ff3-adbb-8fb12d9651a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:00:36.715532 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1011b4-d88c-4ff3-adbb-8fb12d9651a1 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:00:36.715814 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1011b4-d88c-4ff3-adbb-8fb12d9651a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:00:36.716086 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1011b4-d88c-4ff3-adbb-8fb12d9651a1 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:00:36.727797 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1011b4-d88c-4ff3-adbb-8fb12d9651a1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 19:00:36.734439 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application [None req-af1011b4-d88c-4ff3-adbb-8fb12d9651a1 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 28 19:00:36.734439 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 19:00:36.734439 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 19:00:36.734439 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 19:00:36.734439 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 19:00:36.734439 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 19:00:36.734439 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 19:00:36.734439 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 19:00:36.734439 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 19:00:36.734439 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 19:00:36.734439 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 19:00:36.734439 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 19:00:36.734439 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 28 19:00:36.734439 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 28 19:00:36.734439 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 28 19:00:36.734439 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 28 19:00:36.735571 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 28 19:00:36.735571 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 28 19:00:36.735571 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 28 19:00:36.735571 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 28 19:00:36.735571 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 19:00:36.735571 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 19:00:36.735571 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 19:00:36.735571 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 19:00:36.735571 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 19:00:36.735571 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 19:00:36.735571 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 19:00:36.735571 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application with Lock( Oct 28 19:00:36.735571 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 19:00:36.735571 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._enter() Oct 28 19:00:36.735571 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 19:00:36.735571 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 19:00:36.736536 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 19:00:36.736536 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.creator() Oct 28 19:00:36.736536 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 19:00:36.736536 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application created_value = creator( Oct 28 19:00:36.736536 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 28 19:00:36.736536 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 28 19:00:36.736536 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 28 19:00:36.736536 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 28 19:00:36.736536 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 28 19:00:36.736536 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 28 19:00:36.736536 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 28 19:00:36.736536 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Oct 28 19:00:36.739818 dv-cinder-862365-1-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 44/89] 10.222.0.23 () {56 vars in 1099 bytes} [Fri Oct 28 19:00:36 2022] GET /identity/v3/roles/member => generated 84 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 19:00:36.747447 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d47245-c7e5-4944-aa86-da8bcfd3881f None None] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:00:36.764685 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5af94c5-f868-45db-a115-5789fb336e70 None None] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:00:36.765011 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5af94c5-f868-45db-a115-5789fb336e70 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:00:36.765252 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5af94c5-f868-45db-a115-5789fb336e70 None None] PATH_INFO: `/` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:00:36.766907 dv-cinder-862365-1-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 45/90] 10.222.0.23 () {54 vars in 927 bytes} [Fri Oct 28 19:00:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 28 19:00:36.772535 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccbdbdb-ae12-4663-bb4a-ccd58bc3aef5 None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:00:36.773289 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccbdbdb-ae12-4663-bb4a-ccd58bc3aef5 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:00:36.773997 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccbdbdb-ae12-4663-bb4a-ccd58bc3aef5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:00:36.795289 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-bccbdbdb-ae12-4663-bb4a-ccd58bc3aef5 None None] MFA Rules not processed for user `ae863915635746d1ac19970949de4722`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:00:36.796504 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-bccbdbdb-ae12-4663-bb4a-ccd58bc3aef5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:00:36.906262 dv-cinder-862365-1-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 46/91] 10.222.0.23 () {58 vars in 1024 bytes} [Fri Oct 28 19:00:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 28 19:00:36.969091 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c66889-8d09-46ab-98f8-b89271f9a575 None None] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:00:36.969402 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c66889-8d09-46ab-98f8-b89271f9a575 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:00:36.969681 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c66889-8d09-46ab-98f8-b89271f9a575 None None] PATH_INFO: `/` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:00:36.971149 dv-cinder-862365-1-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 47/92] 10.222.0.23 () {54 vars in 927 bytes} [Fri Oct 28 19:00:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 28 19:00:36.979226 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d47245-c7e5-4944-aa86-da8bcfd3881f None None] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:00:36.981241 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e64008-3c4c-444a-b0ea-f583439f78ca None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:00:36.981454 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e64008-3c4c-444a-b0ea-f583439f78ca None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:00:36.981733 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e64008-3c4c-444a-b0ea-f583439f78ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:00:37.013669 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-71e64008-3c4c-444a-b0ea-f583439f78ca None None] MFA Rules not processed for user `ae863915635746d1ac19970949de4722`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:00:37.014935 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-71e64008-3c4c-444a-b0ea-f583439f78ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:00:37.038203 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6926574-bb3d-4f98-8965-858fceec7781 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:00:37.039770 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6926574-bb3d-4f98-8965-858fceec7781 None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:00:37.040489 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6926574-bb3d-4f98-8965-858fceec7781 None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:00:37.041241 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6926574-bb3d-4f98-8965-858fceec7781 None admin] PATH_INFO: `/v3/roles` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:00:37.042282 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6926574-bb3d-4f98-8965-858fceec7781 None admin] RBAC: Adding query filter params (name=member) {{(pid=81765) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:00:37.043318 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6926574-bb3d-4f98-8965-858fceec7781 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:00:37.044901 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6926574-bb3d-4f98-8965-858fceec7781 None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:00:37.054181 dv-cinder-862365-1-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 46/93] 10.222.0.23 () {56 vars in 1101 bytes} [Fri Oct 28 19:00:36 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 307 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:00:37.064832 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6926574-bb3d-4f98-8965-858fceec7781 None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:00:37.079572 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:00:37.141237 dv-cinder-862365-1-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 48/94] 10.222.0.23 () {58 vars in 1024 bytes} [Fri Oct 28 19:00:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 28 19:00:37.245050 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6926574-bb3d-4f98-8965-858fceec7781 None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:00:37.294985 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf29a6d-cf03-45ec-b043-6b6bb4bacf1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:00:37.295692 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf29a6d-cf03-45ec-b043-6b6bb4bacf1f None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:00:37.295987 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf29a6d-cf03-45ec-b043-6b6bb4bacf1f None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:00:37.296265 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf29a6d-cf03-45ec-b043-6b6bb4bacf1f None admin] PATH_INFO: `/v3/users/154626d9963c47efa7bf7e5dd699ae08` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:00:37.297471 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf29a6d-cf03-45ec-b043-6b6bb4bacf1f None admin] RBAC: Authorizing `identity:get_user(user_id=154626d9963c47efa7bf7e5dd699ae08)` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:00:37.298940 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf29a6d-cf03-45ec-b043-6b6bb4bacf1f None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:00:37.300543 dv-cinder-862365-1-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 47/95] 10.222.0.23 () {56 vars in 1177 bytes} [Fri Oct 28 19:00:37 2022] GET /identity/v3/users/154626d9963c47efa7bf7e5dd699ae08 => generated 275 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:00:37.306271 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e64008-3c4c-444a-b0ea-f583439f78ca None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:00:37.353136 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:00:37.411995 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf29a6d-cf03-45ec-b043-6b6bb4bacf1f None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:00:37.451214 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e64008-3c4c-444a-b0ea-f583439f78ca None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:00:37.514436 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88cef75a-2783-462f-a4de-44f8c1401ddd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:00:37.515449 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cef75a-2783-462f-a4de-44f8c1401ddd None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:00:37.515963 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cef75a-2783-462f-a4de-44f8c1401ddd None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:00:37.516447 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cef75a-2783-462f-a4de-44f8c1401ddd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:00:37.590846 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:00:37.607940 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88cef75a-2783-462f-a4de-44f8c1401ddd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:00:37.609734 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88cef75a-2783-462f-a4de-44f8c1401ddd None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:00:37.625200 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf29a6d-cf03-45ec-b043-6b6bb4bacf1f None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:00:37.641403 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:00:37.668734 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7862e38-108c-4cef-80fa-71086ee404eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:00:37.669795 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7862e38-108c-4cef-80fa-71086ee404eb None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:00:37.670230 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7862e38-108c-4cef-80fa-71086ee404eb None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:00:37.671462 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7862e38-108c-4cef-80fa-71086ee404eb None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:00:37.684548 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7862e38-108c-4cef-80fa-71086ee404eb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 19:00:37.691341 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application [None req-e7862e38-108c-4cef-80fa-71086ee404eb None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 28 19:00:37.691341 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 19:00:37.691341 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 19:00:37.691341 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 19:00:37.691341 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 19:00:37.691341 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 19:00:37.691341 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 19:00:37.691341 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 19:00:37.691341 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 19:00:37.691341 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 19:00:37.691341 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 19:00:37.691341 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 19:00:37.691341 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 28 19:00:37.691341 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 28 19:00:37.691341 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 28 19:00:37.691341 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 28 19:00:37.692360 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 28 19:00:37.692360 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 28 19:00:37.692360 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 28 19:00:37.692360 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 28 19:00:37.692360 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 19:00:37.692360 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 19:00:37.692360 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 19:00:37.692360 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 19:00:37.692360 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 19:00:37.692360 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 19:00:37.692360 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 19:00:37.692360 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application with Lock( Oct 28 19:00:37.692360 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 19:00:37.692360 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._enter() Oct 28 19:00:37.692360 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 19:00:37.692360 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 19:00:37.693339 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 19:00:37.693339 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.creator() Oct 28 19:00:37.693339 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 19:00:37.693339 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application created_value = creator( Oct 28 19:00:37.693339 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 28 19:00:37.693339 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 28 19:00:37.693339 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 28 19:00:37.693339 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 28 19:00:37.693339 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 28 19:00:37.693339 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 28 19:00:37.693339 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 28 19:00:37.693339 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application Oct 28 19:00:37.695830 dv-cinder-862365-1-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 48/96] 10.222.0.23 () {56 vars in 1099 bytes} [Fri Oct 28 19:00:37 2022] GET /identity/v3/roles/reader => generated 84 bytes in 284 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 19:00:37.696924 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7862e38-108c-4cef-80fa-71086ee404eb None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:00:37.731021 dv-cinder-862365-1-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 49/97] 10.222.0.23 () {58 vars in 1282 bytes} [Fri Oct 28 19:00:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 425 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 28 19:00:37.733006 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3999f943-b5ea-4494-b2a5-5e6e751f4596 None None] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:00:37.733477 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3999f943-b5ea-4494-b2a5-5e6e751f4596 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:00:37.734168 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3999f943-b5ea-4494-b2a5-5e6e751f4596 None None] PATH_INFO: `/` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:00:37.736315 dv-cinder-862365-1-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 50/98] 10.222.0.23 () {54 vars in 927 bytes} [Fri Oct 28 19:00:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 19:00:37.737183 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3999f943-b5ea-4494-b2a5-5e6e751f4596 None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:00:37.818573 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7862e38-108c-4cef-80fa-71086ee404eb None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:00:37.860238 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f05360e-b98d-4bd4-899e-61f2399830ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:00:37.861102 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f05360e-b98d-4bd4-899e-61f2399830ce None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:00:37.861602 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f05360e-b98d-4bd4-899e-61f2399830ce None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:00:37.861885 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f05360e-b98d-4bd4-899e-61f2399830ce None admin] PATH_INFO: `/v3/domains/default` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:00:37.863088 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f05360e-b98d-4bd4-899e-61f2399830ce None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:00:37.864589 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f05360e-b98d-4bd4-899e-61f2399830ce None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:00:37.871019 dv-cinder-862365-1-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 49/99] 10.222.0.23 () {56 vars in 1108 bytes} [Fri Oct 28 19:00:37 2022] GET /identity/v3/domains/default => generated 199 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:00:37.871019 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f05360e-b98d-4bd4-899e-61f2399830ce None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:00:37.871019 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:00:37.872300 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3999f943-b5ea-4494-b2a5-5e6e751f4596 None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:00:37.907400 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:00:37.913327 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e602702-22e3-471d-bf34-6a7c3e5f5e61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:00:37.913960 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e602702-22e3-471d-bf34-6a7c3e5f5e61 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:00:37.914239 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e602702-22e3-471d-bf34-6a7c3e5f5e61 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:00:37.914513 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e602702-22e3-471d-bf34-6a7c3e5f5e61 None admin] PATH_INFO: `/v3/roles` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:00:37.915337 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e602702-22e3-471d-bf34-6a7c3e5f5e61 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:00:37.915645 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e602702-22e3-471d-bf34-6a7c3e5f5e61 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:00:37.917087 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e602702-22e3-471d-bf34-6a7c3e5f5e61 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:00:37.930484 dv-cinder-862365-1-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 51/100] 10.222.0.23 () {56 vars in 1101 bytes} [Fri Oct 28 19:00:37 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:00:37.930484 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09e5bbc-0135-4280-8dd9-fe98027d80b9 None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:00:37.930484 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09e5bbc-0135-4280-8dd9-fe98027d80b9 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:00:37.930484 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09e5bbc-0135-4280-8dd9-fe98027d80b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:00:37.946941 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-d09e5bbc-0135-4280-8dd9-fe98027d80b9 None None] MFA Rules not processed for user `ae863915635746d1ac19970949de4722`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:00:37.948132 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-d09e5bbc-0135-4280-8dd9-fe98027d80b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:00:37.982205 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f05360e-b98d-4bd4-899e-61f2399830ce None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:00:38.017332 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2da93e-2e79-44f6-b517-fd2f681a2e18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:00:38.017553 dv-cinder-862365-1-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 52/101] 10.222.0.23 () {58 vars in 1024 bytes} [Fri Oct 28 19:00:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 28 19:00:38.017985 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2da93e-2e79-44f6-b517-fd2f681a2e18 None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:00:38.018268 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2da93e-2e79-44f6-b517-fd2f681a2e18 None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:00:38.018541 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2da93e-2e79-44f6-b517-fd2f681a2e18 None admin] PATH_INFO: `/v3/projects/575e6206099b4a24bc9b829f3e7b6bdc` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:00:38.018698 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f135bf7f-6a6b-49fc-a76c-58178bfd7bec None None] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:00:38.018945 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f135bf7f-6a6b-49fc-a76c-58178bfd7bec None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:00:38.019219 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f135bf7f-6a6b-49fc-a76c-58178bfd7bec None None] PATH_INFO: `/` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:00:38.019769 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2da93e-2e79-44f6-b517-fd2f681a2e18 None admin] RBAC: Authorizing `identity:get_project(project_id=575e6206099b4a24bc9b829f3e7b6bdc)` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:00:38.020575 dv-cinder-862365-1-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 53/102] 10.222.0.23 () {54 vars in 927 bytes} [Fri Oct 28 19:00:38 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 19:00:38.021118 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f135bf7f-6a6b-49fc-a76c-58178bfd7bec None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:00:38.025228 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2da93e-2e79-44f6-b517-fd2f681a2e18 None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:00:38.026941 dv-cinder-862365-1-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 50/103] 10.222.0.23 () {56 vars in 1186 bytes} [Fri Oct 28 19:00:37 2022] GET /identity/v3/projects/575e6206099b4a24bc9b829f3e7b6bdc => generated 298 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:00:38.027696 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2da93e-2e79-44f6-b517-fd2f681a2e18 None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:00:38.103862 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:00:38.134484 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f135bf7f-6a6b-49fc-a76c-58178bfd7bec None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:00:38.137280 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2da93e-2e79-44f6-b517-fd2f681a2e18 None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:00:38.158077 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:00:38.170053 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30670b20-77d5-4c6a-8603-fc39c1324f8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:00:38.170728 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30670b20-77d5-4c6a-8603-fc39c1324f8e None admin] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:00:38.171010 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30670b20-77d5-4c6a-8603-fc39c1324f8e None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:00:38.171285 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30670b20-77d5-4c6a-8603-fc39c1324f8e None admin] PATH_INFO: `/v3/projects` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:00:38.171926 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30670b20-77d5-4c6a-8603-fc39c1324f8e None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:00:38.173034 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2234876c-4d77-4fd5-b526-d89eb33c6496 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:00:38.173393 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30670b20-77d5-4c6a-8603-fc39c1324f8e None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:00:38.173702 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2234876c-4d77-4fd5-b526-d89eb33c6496 None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:00:38.174036 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2234876c-4d77-4fd5-b526-d89eb33c6496 None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:00:38.174331 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2234876c-4d77-4fd5-b526-d89eb33c6496 None admin] PATH_INFO: `/v3/users/777c5f75640640b69050e41779968d53` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:00:38.191842 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2234876c-4d77-4fd5-b526-d89eb33c6496 None admin] RBAC: Authorizing `identity:get_user(user_id=777c5f75640640b69050e41779968d53)` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:00:38.193229 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2234876c-4d77-4fd5-b526-d89eb33c6496 None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:00:38.195062 dv-cinder-862365-1-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 51/104] 10.222.0.23 () {56 vars in 1177 bytes} [Fri Oct 28 19:00:38 2022] GET /identity/v3/users/777c5f75640640b69050e41779968d53 => generated 289 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:00:38.196051 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f78ae94-f249-4002-b5e6-5925446e477e None None] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:00:38.196341 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f78ae94-f249-4002-b5e6-5925446e477e None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:00:38.196621 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f78ae94-f249-4002-b5e6-5925446e477e None None] PATH_INFO: `/` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:00:38.197949 dv-cinder-862365-1-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 52/105] 10.222.0.23 () {54 vars in 927 bytes} [Fri Oct 28 19:00:38 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 19:00:38.199451 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227f3a36-a0d6-4023-ba51-467e386fe847 None None] REQUEST_METHOD: `POST` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:00:38.200006 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227f3a36-a0d6-4023-ba51-467e386fe847 None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:00:38.200006 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227f3a36-a0d6-4023-ba51-467e386fe847 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:00:38.218168 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.auth.core [None req-227f3a36-a0d6-4023-ba51-467e386fe847 None None] MFA Rules not processed for user `ae863915635746d1ac19970949de4722`. Rule list: `[]` (Enabled: `True`). {{(pid=81765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:00:38.219362 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-227f3a36-a0d6-4023-ba51-467e386fe847 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:00:38.234416 dv-cinder-862365-1-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 54/106] 10.222.0.23 () {60 vars in 1141 bytes} [Fri Oct 28 19:00:38 2022] POST /identity/v3/projects => generated 302 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 19:00:38.235263 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30670b20-77d5-4c6a-8603-fc39c1324f8e None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:00:38.311633 dv-cinder-862365-1-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 53/107] 10.222.0.23 () {58 vars in 1024 bytes} [Fri Oct 28 19:00:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 28 19:00:38.312518 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227f3a36-a0d6-4023-ba51-467e386fe847 None None] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:00:38.383749 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:00:38.389540 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30670b20-77d5-4c6a-8603-fc39c1324f8e None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:00:38.432780 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227f3a36-a0d6-4023-ba51-467e386fe847 None None] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:00:38.434873 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3f9601-ab07-47d4-a7cf-b7c94502c7a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:00:38.435495 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3f9601-ab07-47d4-a7cf-b7c94502c7a5 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:00:38.435788 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3f9601-ab07-47d4-a7cf-b7c94502c7a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:00:38.436068 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3f9601-ab07-47d4-a7cf-b7c94502c7a5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:00:38.436809 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a3f9601-ab07-47d4-a7cf-b7c94502c7a5 None admin] RBAC: Adding query filter params (role.id=c193f661c7504bdf80c036f745eba59b, scope.project.id=575e6206099b4a24bc9b829f3e7b6bdc, user.id=154626d9963c47efa7bf7e5dd699ae08) {{(pid=81766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:00:38.437125 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a3f9601-ab07-47d4-a7cf-b7c94502c7a5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:00:38.438613 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a3f9601-ab07-47d4-a7cf-b7c94502c7a5 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:00:38.449603 dv-cinder-862365-1-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 55/108] 10.222.0.23 () {56 vars in 1374 bytes} [Fri Oct 28 19:00:38 2022] GET /identity/v3/role_assignments?user.id=154626d9963c47efa7bf7e5dd699ae08&scope.project.id=575e6206099b4a24bc9b829f3e7b6bdc&role.id=c193f661c7504bdf80c036f745eba59b => generated 608 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:00:38.450842 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe201de-c179-41de-9a4e-1ca3f021edc3 None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:00:38.451143 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe201de-c179-41de-9a4e-1ca3f021edc3 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:00:38.451424 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe201de-c179-41de-9a4e-1ca3f021edc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:00:38.473096 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-9fe201de-c179-41de-9a4e-1ca3f021edc3 None None] MFA Rules not processed for user `ae863915635746d1ac19970949de4722`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:00:38.474374 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-9fe201de-c179-41de-9a4e-1ca3f021edc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:00:38.493479 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682a5d33-7a5b-4a96-baa2-b0143a45675b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:00:38.494925 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682a5d33-7a5b-4a96-baa2-b0143a45675b None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:00:38.495391 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682a5d33-7a5b-4a96-baa2-b0143a45675b None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:00:38.496549 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682a5d33-7a5b-4a96-baa2-b0143a45675b None admin] PATH_INFO: `/v3/projects/575e6206099b4a24bc9b829f3e7b6bdc` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:00:38.498436 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682a5d33-7a5b-4a96-baa2-b0143a45675b None admin] RBAC: Authorizing `identity:get_project(project_id=575e6206099b4a24bc9b829f3e7b6bdc)` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:00:38.500638 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682a5d33-7a5b-4a96-baa2-b0143a45675b None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:00:38.503227 dv-cinder-862365-1-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 54/109] 10.222.0.23 () {56 vars in 1186 bytes} [Fri Oct 28 19:00:38 2022] GET /identity/v3/projects/575e6206099b4a24bc9b829f3e7b6bdc => generated 298 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:00:38.504356 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682a5d33-7a5b-4a96-baa2-b0143a45675b None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:00:38.519897 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:00:38.567285 dv-cinder-862365-1-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 56/110] 10.222.0.23 () {58 vars in 1024 bytes} [Fri Oct 28 19:00:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 28 19:00:38.568331 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe201de-c179-41de-9a4e-1ca3f021edc3 None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:00:38.666228 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682a5d33-7a5b-4a96-baa2-b0143a45675b None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:00:38.699234 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:00:38.714350 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94808c05-6caf-41e7-88f0-8db4b89dde71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:00:38.714350 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94808c05-6caf-41e7-88f0-8db4b89dde71 None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:00:38.714350 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94808c05-6caf-41e7-88f0-8db4b89dde71 None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:00:38.714350 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94808c05-6caf-41e7-88f0-8db4b89dde71 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:00:38.715228 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe201de-c179-41de-9a4e-1ca3f021edc3 None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:00:38.724354 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94808c05-6caf-41e7-88f0-8db4b89dde71 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 19:00:38.737319 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application [None req-94808c05-6caf-41e7-88f0-8db4b89dde71 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 28 19:00:38.737319 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 19:00:38.737319 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 19:00:38.737319 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 19:00:38.737319 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 19:00:38.737319 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 19:00:38.737319 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 19:00:38.737319 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 19:00:38.737319 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 19:00:38.737319 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 19:00:38.737319 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 19:00:38.737319 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 19:00:38.737319 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 28 19:00:38.737319 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 28 19:00:38.737319 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 28 19:00:38.737319 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 28 19:00:38.738364 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 28 19:00:38.738364 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 28 19:00:38.738364 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 28 19:00:38.738364 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 28 19:00:38.738364 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 19:00:38.738364 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 19:00:38.738364 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 19:00:38.738364 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 19:00:38.738364 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 19:00:38.738364 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 19:00:38.738364 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 19:00:38.738364 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application with Lock( Oct 28 19:00:38.738364 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 19:00:38.738364 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._enter() Oct 28 19:00:38.738364 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 19:00:38.738364 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 19:00:38.739133 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 19:00:38.739133 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.creator() Oct 28 19:00:38.739133 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 19:00:38.739133 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application created_value = creator( Oct 28 19:00:38.739133 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 28 19:00:38.739133 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 28 19:00:38.739133 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 28 19:00:38.739133 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 28 19:00:38.739133 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 28 19:00:38.739133 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 28 19:00:38.739133 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 28 19:00:38.739133 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application Oct 28 19:00:38.739133 dv-cinder-862365-1-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 55/111] 10.222.0.23 () {56 vars in 1114 bytes} [Fri Oct 28 19:00:38 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 19:00:38.739133 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94808c05-6caf-41e7-88f0-8db4b89dde71 None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:00:38.760455 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9befa2-c725-4830-a54c-43596442fc30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:00:38.761204 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9befa2-c725-4830-a54c-43596442fc30 None admin] REQUEST_METHOD: `PUT` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:00:38.762257 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9befa2-c725-4830-a54c-43596442fc30 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:00:38.762544 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9befa2-c725-4830-a54c-43596442fc30 None admin] PATH_INFO: `/v3/projects/575e6206099b4a24bc9b829f3e7b6bdc/users/777c5f75640640b69050e41779968d53/roles/ba7a86f4918e49709c1bae8d5942bf42` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:00:38.765126 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9befa2-c725-4830-a54c-43596442fc30 None admin] RBAC: Authorizing `identity:create_grant(project_id=575e6206099b4a24bc9b829f3e7b6bdc, user_id=777c5f75640640b69050e41779968d53, role_id=ba7a86f4918e49709c1bae8d5942bf42)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:00:38.767151 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9befa2-c725-4830-a54c-43596442fc30 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:00:38.853504 dv-cinder-862365-1-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 57/112] 10.222.0.23 () {58 vars in 1439 bytes} [Fri Oct 28 19:00:38 2022] PUT /identity/v3/projects/575e6206099b4a24bc9b829f3e7b6bdc/users/777c5f75640640b69050e41779968d53/roles/ba7a86f4918e49709c1bae8d5942bf42 => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 19:00:38.854778 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9befa2-c725-4830-a54c-43596442fc30 None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:00:38.873572 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94808c05-6caf-41e7-88f0-8db4b89dde71 None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:00:38.906215 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:00:38.918183 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4751e00-9600-4c45-bfb1-93174e4df12f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:00:38.919217 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4751e00-9600-4c45-bfb1-93174e4df12f None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:00:38.919509 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4751e00-9600-4c45-bfb1-93174e4df12f None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:00:38.919828 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4751e00-9600-4c45-bfb1-93174e4df12f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:00:38.933590 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4751e00-9600-4c45-bfb1-93174e4df12f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 19:00:38.938869 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application [None req-b4751e00-9600-4c45-bfb1-93174e4df12f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 28 19:00:38.938869 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 19:00:38.938869 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 19:00:38.938869 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 19:00:38.938869 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 19:00:38.938869 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 19:00:38.938869 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 19:00:38.938869 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 19:00:38.938869 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 19:00:38.938869 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 19:00:38.938869 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 19:00:38.938869 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 19:00:38.938869 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 28 19:00:38.938869 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 28 19:00:38.938869 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 28 19:00:38.938869 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 28 19:00:38.939869 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 28 19:00:38.939869 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 28 19:00:38.939869 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 28 19:00:38.939869 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 28 19:00:38.939869 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 19:00:38.939869 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 19:00:38.939869 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 19:00:38.939869 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 19:00:38.939869 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 19:00:38.939869 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 19:00:38.939869 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 19:00:38.939869 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application with Lock( Oct 28 19:00:38.939869 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 19:00:38.939869 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._enter() Oct 28 19:00:38.939869 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 19:00:38.939869 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 19:00:38.940655 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 19:00:38.940655 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.creator() Oct 28 19:00:38.940655 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 19:00:38.940655 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application created_value = creator( Oct 28 19:00:38.940655 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 28 19:00:38.940655 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 28 19:00:38.940655 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 28 19:00:38.940655 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 28 19:00:38.940655 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 28 19:00:38.940655 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 28 19:00:38.940655 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 28 19:00:38.940655 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application Oct 28 19:00:38.940655 dv-cinder-862365-1-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 56/113] 10.222.0.23 () {56 vars in 1096 bytes} [Fri Oct 28 19:00:38 2022] GET /identity/v3/roles/admin => generated 83 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 19:00:38.941732 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4751e00-9600-4c45-bfb1-93174e4df12f None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:00:38.985815 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9befa2-c725-4830-a54c-43596442fc30 None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:00:39.003878 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:00:39.035478 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e2cafe-70af-4fab-8f16-b6d2024fcc1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:00:39.035478 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e2cafe-70af-4fab-8f16-b6d2024fcc1a None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:00:39.035762 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e2cafe-70af-4fab-8f16-b6d2024fcc1a None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:00:39.036051 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e2cafe-70af-4fab-8f16-b6d2024fcc1a None admin] PATH_INFO: `/v3/roles` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:00:39.037042 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e2cafe-70af-4fab-8f16-b6d2024fcc1a None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:00:39.038305 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e2cafe-70af-4fab-8f16-b6d2024fcc1a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:00:39.039118 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e2cafe-70af-4fab-8f16-b6d2024fcc1a None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:00:39.048377 dv-cinder-862365-1-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 58/114] 10.222.0.23 () {56 vars in 1111 bytes} [Fri Oct 28 19:00:38 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:00:39.049291 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e2cafe-70af-4fab-8f16-b6d2024fcc1a None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:00:39.068452 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4751e00-9600-4c45-bfb1-93174e4df12f None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:00:39.114457 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505ae137-bd0f-47b7-94f9-ff177e42ce56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:00:39.115878 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505ae137-bd0f-47b7-94f9-ff177e42ce56 None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:00:39.116421 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505ae137-bd0f-47b7-94f9-ff177e42ce56 None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:00:39.117497 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505ae137-bd0f-47b7-94f9-ff177e42ce56 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:00:39.135590 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505ae137-bd0f-47b7-94f9-ff177e42ce56 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 19:00:39.142842 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application [None req-505ae137-bd0f-47b7-94f9-ff177e42ce56 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 28 19:00:39.142842 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 19:00:39.142842 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 19:00:39.142842 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 19:00:39.142842 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 19:00:39.142842 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 19:00:39.142842 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 19:00:39.142842 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 19:00:39.142842 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 19:00:39.142842 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 19:00:39.142842 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 19:00:39.142842 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 19:00:39.142842 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 28 19:00:39.142842 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 28 19:00:39.142842 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 28 19:00:39.142842 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 28 19:00:39.143734 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 28 19:00:39.143734 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 28 19:00:39.143734 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 28 19:00:39.143734 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 28 19:00:39.143734 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 19:00:39.143734 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 19:00:39.143734 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 19:00:39.143734 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 19:00:39.143734 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 19:00:39.143734 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 19:00:39.143734 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 19:00:39.143734 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application with Lock( Oct 28 19:00:39.143734 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 19:00:39.143734 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._enter() Oct 28 19:00:39.143734 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 19:00:39.143734 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 19:00:39.144645 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 19:00:39.144645 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.creator() Oct 28 19:00:39.144645 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 19:00:39.144645 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application created_value = creator( Oct 28 19:00:39.144645 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 28 19:00:39.144645 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 28 19:00:39.144645 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 28 19:00:39.144645 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 28 19:00:39.144645 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 28 19:00:39.144645 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 28 19:00:39.144645 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 28 19:00:39.144645 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application Oct 28 19:00:39.144645 dv-cinder-862365-1-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 57/115] 10.222.0.23 () {56 vars in 1099 bytes} [Fri Oct 28 19:00:38 2022] GET /identity/v3/roles/member => generated 84 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 19:00:39.146338 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505ae137-bd0f-47b7-94f9-ff177e42ce56 None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:00:39.170315 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:00:39.181633 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e2cafe-70af-4fab-8f16-b6d2024fcc1a None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:00:39.221230 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d62f4dc-3aba-44cd-b2b7-ae200411be4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:00:39.222305 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d62f4dc-3aba-44cd-b2b7-ae200411be4a None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:00:39.222954 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d62f4dc-3aba-44cd-b2b7-ae200411be4a None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:00:39.223515 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d62f4dc-3aba-44cd-b2b7-ae200411be4a None admin] PATH_INFO: `/v3/roles` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:00:39.224380 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d62f4dc-3aba-44cd-b2b7-ae200411be4a None admin] RBAC: Adding query filter params (name=admin) {{(pid=81766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:00:39.224893 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d62f4dc-3aba-44cd-b2b7-ae200411be4a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:00:39.226718 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d62f4dc-3aba-44cd-b2b7-ae200411be4a None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:00:39.240718 dv-cinder-862365-1-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 59/116] 10.222.0.23 () {56 vars in 1099 bytes} [Fri Oct 28 19:00:39 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:00:39.241298 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d62f4dc-3aba-44cd-b2b7-ae200411be4a None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:00:39.282776 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505ae137-bd0f-47b7-94f9-ff177e42ce56 None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:00:39.292845 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:00:39.320998 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ba41d8-46d9-4a73-88a4-b16a41f28faf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:00:39.321668 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ba41d8-46d9-4a73-88a4-b16a41f28faf None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:00:39.322009 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ba41d8-46d9-4a73-88a4-b16a41f28faf None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:00:39.322286 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ba41d8-46d9-4a73-88a4-b16a41f28faf None admin] PATH_INFO: `/v3/users/154626d9963c47efa7bf7e5dd699ae08` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:00:39.323448 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ba41d8-46d9-4a73-88a4-b16a41f28faf None admin] RBAC: Authorizing `identity:get_user(user_id=154626d9963c47efa7bf7e5dd699ae08)` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:00:39.325502 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ba41d8-46d9-4a73-88a4-b16a41f28faf None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:00:39.327322 dv-cinder-862365-1-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 58/117] 10.222.0.23 () {56 vars in 1177 bytes} [Fri Oct 28 19:00:39 2022] GET /identity/v3/users/154626d9963c47efa7bf7e5dd699ae08 => generated 275 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:00:39.333127 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ba41d8-46d9-4a73-88a4-b16a41f28faf None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:00:39.378520 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d62f4dc-3aba-44cd-b2b7-ae200411be4a None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:00:39.425091 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e10ea6-ea1a-46f9-b9db-90c86b763030 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:00:39.427023 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e10ea6-ea1a-46f9-b9db-90c86b763030 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:00:39.427523 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e10ea6-ea1a-46f9-b9db-90c86b763030 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:00:39.428247 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e10ea6-ea1a-46f9-b9db-90c86b763030 None admin] PATH_INFO: `/v3/roles` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:00:39.429259 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e10ea6-ea1a-46f9-b9db-90c86b763030 None admin] RBAC: Adding query filter params (name=member) {{(pid=81766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:00:39.429795 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e10ea6-ea1a-46f9-b9db-90c86b763030 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:00:39.431669 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e10ea6-ea1a-46f9-b9db-90c86b763030 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:00:39.443810 dv-cinder-862365-1-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 60/118] 10.222.0.23 () {56 vars in 1101 bytes} [Fri Oct 28 19:00:39 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:00:39.444961 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e10ea6-ea1a-46f9-b9db-90c86b763030 None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:00:39.450271 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ba41d8-46d9-4a73-88a4-b16a41f28faf None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:00:39.465885 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:00:39.487581 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31e0e6a-0aed-4277-8262-dbb9853e4d45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:00:39.488201 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31e0e6a-0aed-4277-8262-dbb9853e4d45 None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:00:39.488479 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31e0e6a-0aed-4277-8262-dbb9853e4d45 None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:00:39.488747 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31e0e6a-0aed-4277-8262-dbb9853e4d45 None admin] PATH_INFO: `/v3/users/ae863915635746d1ac19970949de4722` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:00:39.489964 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31e0e6a-0aed-4277-8262-dbb9853e4d45 None admin] RBAC: Authorizing `identity:get_user(user_id=ae863915635746d1ac19970949de4722)` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:00:39.491524 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31e0e6a-0aed-4277-8262-dbb9853e4d45 None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:00:39.493343 dv-cinder-862365-1-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 59/119] 10.222.0.23 () {56 vars in 1177 bytes} [Fri Oct 28 19:00:39 2022] GET /identity/v3/users/ae863915635746d1ac19970949de4722 => generated 247 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:00:39.498183 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31e0e6a-0aed-4277-8262-dbb9853e4d45 None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:00:39.549187 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:00:39.578213 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e10ea6-ea1a-46f9-b9db-90c86b763030 None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:00:39.613871 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31e0e6a-0aed-4277-8262-dbb9853e4d45 None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:00:39.626160 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f02cf7a-84b4-4244-a3d1-249ce9b236cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:00:39.627301 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f02cf7a-84b4-4244-a3d1-249ce9b236cf None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:00:39.627738 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f02cf7a-84b4-4244-a3d1-249ce9b236cf None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:00:39.628420 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f02cf7a-84b4-4244-a3d1-249ce9b236cf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:00:39.650529 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278a35cf-6b18-44fe-83c5-1bcdfb9c4d67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:00:39.651165 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278a35cf-6b18-44fe-83c5-1bcdfb9c4d67 None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:00:39.651725 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278a35cf-6b18-44fe-83c5-1bcdfb9c4d67 None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:00:39.652341 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278a35cf-6b18-44fe-83c5-1bcdfb9c4d67 None admin] PATH_INFO: `/v3/users/154626d9963c47efa7bf7e5dd699ae08` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:00:39.653487 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-278a35cf-6b18-44fe-83c5-1bcdfb9c4d67 None admin] RBAC: Authorizing `identity:get_user(user_id=154626d9963c47efa7bf7e5dd699ae08)` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:00:39.655046 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-278a35cf-6b18-44fe-83c5-1bcdfb9c4d67 None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:00:39.656770 dv-cinder-862365-1-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 60/120] 10.222.0.23 () {56 vars in 1177 bytes} [Fri Oct 28 19:00:39 2022] GET /identity/v3/users/154626d9963c47efa7bf7e5dd699ae08 => generated 275 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:00:39.662028 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278a35cf-6b18-44fe-83c5-1bcdfb9c4d67 None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:00:39.712347 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f02cf7a-84b4-4244-a3d1-249ce9b236cf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:00:39.713862 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f02cf7a-84b4-4244-a3d1-249ce9b236cf None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:00:39.730789 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:00:39.803119 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278a35cf-6b18-44fe-83c5-1bcdfb9c4d67 None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:00:39.821493 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:00:39.822355 dv-cinder-862365-1-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 61/121] 10.222.0.23 () {58 vars in 1282 bytes} [Fri Oct 28 19:00:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 28 19:00:39.827920 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f02cf7a-84b4-4244-a3d1-249ce9b236cf None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:00:39.848691 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad37b557-6a94-4159-a3ea-e58b6bc065d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:00:39.849314 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad37b557-6a94-4159-a3ea-e58b6bc065d1 None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:00:39.849630 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad37b557-6a94-4159-a3ea-e58b6bc065d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:00:39.849912 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad37b557-6a94-4159-a3ea-e58b6bc065d1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:00:39.938398 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad37b557-6a94-4159-a3ea-e58b6bc065d1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:00:39.939408 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f02cf7a-84b4-4244-a3d1-249ce9b236cf None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:00:39.940261 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad37b557-6a94-4159-a3ea-e58b6bc065d1 None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:00:39.958180 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:00:39.986941 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c212f3-c2c9-424d-962c-fb11543f34e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:00:39.987646 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c212f3-c2c9-424d-962c-fb11543f34e5 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:00:39.988004 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c212f3-c2c9-424d-962c-fb11543f34e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:00:39.988350 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c212f3-c2c9-424d-962c-fb11543f34e5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:00:40.049134 dv-cinder-862365-1-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 61/122] 10.222.0.23 () {58 vars in 1282 bytes} [Fri Oct 28 19:00:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 392 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 28 19:00:40.050389 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad37b557-6a94-4159-a3ea-e58b6bc065d1 None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:00:40.066391 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:00:40.081799 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c212f3-c2c9-424d-962c-fb11543f34e5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:00:40.083953 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c212f3-c2c9-424d-962c-fb11543f34e5 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:00:40.176690 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad37b557-6a94-4159-a3ea-e58b6bc065d1 None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:00:40.190998 dv-cinder-862365-1-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 62/123] 10.222.0.23 () {58 vars in 1282 bytes} [Fri Oct 28 19:00:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 28 19:00:40.191945 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c212f3-c2c9-424d-962c-fb11543f34e5 None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:00:40.207747 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:00:40.222172 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3849ce-9058-44e5-8cfe-6ec9c5d883f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:00:40.223031 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3849ce-9058-44e5-8cfe-6ec9c5d883f9 None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:00:40.223325 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3849ce-9058-44e5-8cfe-6ec9c5d883f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:00:40.223608 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3849ce-9058-44e5-8cfe-6ec9c5d883f9 None admin] PATH_INFO: `/v3/projects/575e6206099b4a24bc9b829f3e7b6bdc` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:00:40.225514 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3849ce-9058-44e5-8cfe-6ec9c5d883f9 None admin] RBAC: Authorizing `identity:get_project(project_id=575e6206099b4a24bc9b829f3e7b6bdc)` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:00:40.227002 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3849ce-9058-44e5-8cfe-6ec9c5d883f9 None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:00:40.229726 dv-cinder-862365-1-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 62/124] 10.222.0.23 () {56 vars in 1186 bytes} [Fri Oct 28 19:00:40 2022] GET /identity/v3/projects/575e6206099b4a24bc9b829f3e7b6bdc => generated 298 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:00:40.230636 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3849ce-9058-44e5-8cfe-6ec9c5d883f9 None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:00:40.301223 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c212f3-c2c9-424d-962c-fb11543f34e5 None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:00:40.335358 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:00:40.339898 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce887e20-9133-4074-bc81-56024fa5dcb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:00:40.340721 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce887e20-9133-4074-bc81-56024fa5dcb7 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:00:40.341108 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce887e20-9133-4074-bc81-56024fa5dcb7 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:00:40.341538 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce887e20-9133-4074-bc81-56024fa5dcb7 None admin] PATH_INFO: `/v3/projects/575e6206099b4a24bc9b829f3e7b6bdc` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:00:40.342983 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce887e20-9133-4074-bc81-56024fa5dcb7 None admin] RBAC: Authorizing `identity:get_project(project_id=575e6206099b4a24bc9b829f3e7b6bdc)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:00:40.344591 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce887e20-9133-4074-bc81-56024fa5dcb7 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:00:40.346371 dv-cinder-862365-1-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 63/125] 10.222.0.23 () {56 vars in 1186 bytes} [Fri Oct 28 19:00:40 2022] GET /identity/v3/projects/575e6206099b4a24bc9b829f3e7b6bdc => generated 298 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:00:40.351910 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce887e20-9133-4074-bc81-56024fa5dcb7 None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:00:40.357782 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3849ce-9058-44e5-8cfe-6ec9c5d883f9 None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:00:40.404637 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5cfd3b-a760-479f-81d5-d228d4019f41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:00:40.405575 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5cfd3b-a760-479f-81d5-d228d4019f41 None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:00:40.405866 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5cfd3b-a760-479f-81d5-d228d4019f41 None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:00:40.406627 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5cfd3b-a760-479f-81d5-d228d4019f41 None admin] PATH_INFO: `/v3/projects/aa484ffa21624bd4a1402cbd4342aeba` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:00:40.408065 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5cfd3b-a760-479f-81d5-d228d4019f41 None admin] RBAC: Authorizing `identity:get_project(project_id=aa484ffa21624bd4a1402cbd4342aeba)` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:00:40.410208 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5cfd3b-a760-479f-81d5-d228d4019f41 None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:00:40.411856 dv-cinder-862365-1-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 63/126] 10.222.0.23 () {56 vars in 1186 bytes} [Fri Oct 28 19:00:40 2022] GET /identity/v3/projects/aa484ffa21624bd4a1402cbd4342aeba => generated 312 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:00:40.413284 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5cfd3b-a760-479f-81d5-d228d4019f41 None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:00:40.449524 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:00:40.473777 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce887e20-9133-4074-bc81-56024fa5dcb7 None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:00:40.511980 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416180d2-0ea0-4221-8ca8-1424bfb48259 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:00:40.512603 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416180d2-0ea0-4221-8ca8-1424bfb48259 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:00:40.512890 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416180d2-0ea0-4221-8ca8-1424bfb48259 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:00:40.513172 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416180d2-0ea0-4221-8ca8-1424bfb48259 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:00:40.513930 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416180d2-0ea0-4221-8ca8-1424bfb48259 None admin] RBAC: Adding query filter params (role.id=a11a1b300fe044b5a905284bc623dc41, scope.project.id=575e6206099b4a24bc9b829f3e7b6bdc, user.id=154626d9963c47efa7bf7e5dd699ae08) {{(pid=81766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:00:40.514291 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416180d2-0ea0-4221-8ca8-1424bfb48259 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:00:40.515755 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416180d2-0ea0-4221-8ca8-1424bfb48259 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:00:40.529381 dv-cinder-862365-1-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 64/127] 10.222.0.23 () {56 vars in 1374 bytes} [Fri Oct 28 19:00:40 2022] GET /identity/v3/role_assignments?user.id=154626d9963c47efa7bf7e5dd699ae08&scope.project.id=575e6206099b4a24bc9b829f3e7b6bdc&role.id=a11a1b300fe044b5a905284bc623dc41 => generated 608 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:00:40.529381 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416180d2-0ea0-4221-8ca8-1424bfb48259 None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:00:40.534906 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5cfd3b-a760-479f-81d5-d228d4019f41 None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:00:40.607679 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60bdb0b-950d-4bfa-80f7-08deda02c7a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:00:40.608232 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60bdb0b-950d-4bfa-80f7-08deda02c7a4 None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:00:40.608517 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60bdb0b-950d-4bfa-80f7-08deda02c7a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:00:40.608797 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60bdb0b-950d-4bfa-80f7-08deda02c7a4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:00:40.609575 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c60bdb0b-950d-4bfa-80f7-08deda02c7a4 None admin] RBAC: Adding query filter params (role.id=a9e4e47c2bf448fcbada91c1174644f7, scope.project.id=575e6206099b4a24bc9b829f3e7b6bdc, user.id=ae863915635746d1ac19970949de4722) {{(pid=81765) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:00:40.609893 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c60bdb0b-950d-4bfa-80f7-08deda02c7a4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:00:40.611410 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c60bdb0b-950d-4bfa-80f7-08deda02c7a4 None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:00:40.630340 dv-cinder-862365-1-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 64/128] 10.222.0.23 () {56 vars in 1374 bytes} [Fri Oct 28 19:00:40 2022] GET /identity/v3/role_assignments?user.id=ae863915635746d1ac19970949de4722&scope.project.id=575e6206099b4a24bc9b829f3e7b6bdc&role.id=a9e4e47c2bf448fcbada91c1174644f7 => generated 608 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:00:40.665645 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d2b5f5-5b3b-4a37-938f-f4776b89c233 None None] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:00:40.665943 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d2b5f5-5b3b-4a37-938f-f4776b89c233 None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:00:40.666208 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d2b5f5-5b3b-4a37-938f-f4776b89c233 None None] PATH_INFO: `/` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:00:40.667649 dv-cinder-862365-1-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 65/129] 10.222.0.23 () {54 vars in 927 bytes} [Fri Oct 28 19:00:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 28 19:00:40.675577 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416180d2-0ea0-4221-8ca8-1424bfb48259 None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:00:40.679120 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e526bad2-2b4c-4831-b0a1-459811234c46 None None] REQUEST_METHOD: `POST` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:00:40.679405 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e526bad2-2b4c-4831-b0a1-459811234c46 None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:00:40.679724 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e526bad2-2b4c-4831-b0a1-459811234c46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:00:40.710366 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.auth.core [None req-e526bad2-2b4c-4831-b0a1-459811234c46 None None] MFA Rules not processed for user `ae863915635746d1ac19970949de4722`. Rule list: `[]` (Enabled: `True`). {{(pid=81765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:00:40.711877 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-e526bad2-2b4c-4831-b0a1-459811234c46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:00:40.724118 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:00:40.744595 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16f9317-9701-4fb8-a56f-dc3c7c0ef16f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:00:40.745225 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16f9317-9701-4fb8-a56f-dc3c7c0ef16f None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:00:40.745573 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16f9317-9701-4fb8-a56f-dc3c7c0ef16f None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:00:40.745852 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16f9317-9701-4fb8-a56f-dc3c7c0ef16f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:00:40.746600 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16f9317-9701-4fb8-a56f-dc3c7c0ef16f None admin] RBAC: Adding query filter params (role.id=c193f661c7504bdf80c036f745eba59b, scope.project.id=aa484ffa21624bd4a1402cbd4342aeba, user.id=154626d9963c47efa7bf7e5dd699ae08) {{(pid=81766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:00:40.746912 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16f9317-9701-4fb8-a56f-dc3c7c0ef16f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:00:40.748407 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16f9317-9701-4fb8-a56f-dc3c7c0ef16f None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:00:40.757389 dv-cinder-862365-1-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 65/130] 10.222.0.23 () {56 vars in 1374 bytes} [Fri Oct 28 19:00:40 2022] GET /identity/v3/role_assignments?user.id=154626d9963c47efa7bf7e5dd699ae08&scope.project.id=aa484ffa21624bd4a1402cbd4342aeba&role.id=c193f661c7504bdf80c036f745eba59b => generated 608 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:00:40.832340 dv-cinder-862365-1-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 66/131] 10.222.0.23 () {58 vars in 1024 bytes} [Fri Oct 28 19:00:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 28 19:00:41.108751 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16f9317-9701-4fb8-a56f-dc3c7c0ef16f None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:00:41.121513 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:00:41.173572 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d28fdc-65ea-44ec-a3ca-970c0b6b6d50 None None] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:00:41.173864 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d28fdc-65ea-44ec-a3ca-970c0b6b6d50 None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:00:41.174363 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d28fdc-65ea-44ec-a3ca-970c0b6b6d50 None None] PATH_INFO: `/` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:00:41.176095 dv-cinder-862365-1-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 67/132] 10.222.0.23 () {54 vars in 927 bytes} [Fri Oct 28 19:00:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 28 19:00:41.181108 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1426f39-c548-41a9-a549-f5d91c6cbf27 None None] REQUEST_METHOD: `POST` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:00:41.181709 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1426f39-c548-41a9-a549-f5d91c6cbf27 None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:00:41.181709 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1426f39-c548-41a9-a549-f5d91c6cbf27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:00:41.199804 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.auth.core [None req-e1426f39-c548-41a9-a549-f5d91c6cbf27 None None] MFA Rules not processed for user `ae863915635746d1ac19970949de4722`. Rule list: `[]` (Enabled: `True`). {{(pid=81765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:00:41.200992 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-e1426f39-c548-41a9-a549-f5d91c6cbf27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:00:41.219723 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16f9317-9701-4fb8-a56f-dc3c7c0ef16f None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:00:41.254732 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54fc356-0f72-4bea-9765-db6679ce84ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:00:41.255364 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54fc356-0f72-4bea-9765-db6679ce84ec None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:00:41.255651 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54fc356-0f72-4bea-9765-db6679ce84ec None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:00:41.255933 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54fc356-0f72-4bea-9765-db6679ce84ec None admin] PATH_INFO: `/v3/domains/default` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:00:41.257070 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54fc356-0f72-4bea-9765-db6679ce84ec None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:00:41.258571 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54fc356-0f72-4bea-9765-db6679ce84ec None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:00:41.260154 dv-cinder-862365-1-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 66/133] 10.222.0.23 () {56 vars in 1108 bytes} [Fri Oct 28 19:00:41 2022] GET /identity/v3/domains/default => generated 199 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:00:41.265832 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54fc356-0f72-4bea-9765-db6679ce84ec None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:00:41.266765 dv-cinder-862365-1-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 68/134] 10.222.0.23 () {58 vars in 1024 bytes} [Fri Oct 28 19:00:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 28 19:00:41.342872 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:00:41.363734 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54fc356-0f72-4bea-9765-db6679ce84ec None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:00:41.396728 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48fb243-1711-40ca-a861-412b93525454 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:00:41.397326 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48fb243-1711-40ca-a861-412b93525454 None admin] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:00:41.397639 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48fb243-1711-40ca-a861-412b93525454 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:00:41.397915 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48fb243-1711-40ca-a861-412b93525454 None admin] PATH_INFO: `/v3/users` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:00:41.398570 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48fb243-1711-40ca-a861-412b93525454 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:00:41.400008 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48fb243-1711-40ca-a861-412b93525454 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:00:41.475475 dv-cinder-862365-1-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 67/135] 10.222.0.23 () {60 vars in 1132 bytes} [Fri Oct 28 19:00:41 2022] POST /identity/v3/users => generated 283 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 28 19:00:41.536248 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1426f39-c548-41a9-a549-f5d91c6cbf27 None None] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:00:41.607741 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:00:41.638773 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1426f39-c548-41a9-a549-f5d91c6cbf27 None None] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:00:41.673194 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef86575-02c1-44f1-8741-3884c7b08d9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:00:41.673854 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef86575-02c1-44f1-8741-3884c7b08d9b None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:00:41.674137 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef86575-02c1-44f1-8741-3884c7b08d9b None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:00:41.674409 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef86575-02c1-44f1-8741-3884c7b08d9b None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:00:41.684286 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef86575-02c1-44f1-8741-3884c7b08d9b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 19:00:41.689101 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application [None req-aef86575-02c1-44f1-8741-3884c7b08d9b None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 28 19:00:41.689101 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 19:00:41.689101 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 19:00:41.689101 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 19:00:41.689101 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 19:00:41.689101 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 19:00:41.689101 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 19:00:41.689101 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 19:00:41.689101 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 19:00:41.689101 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 19:00:41.689101 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 19:00:41.689101 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 19:00:41.689101 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 28 19:00:41.689101 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 28 19:00:41.689101 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 28 19:00:41.689101 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 28 19:00:41.690004 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 28 19:00:41.690004 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 28 19:00:41.690004 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 28 19:00:41.690004 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 28 19:00:41.690004 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 19:00:41.690004 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 19:00:41.690004 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 19:00:41.690004 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 19:00:41.690004 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 19:00:41.690004 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 19:00:41.690004 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 19:00:41.690004 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application with Lock( Oct 28 19:00:41.690004 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 19:00:41.690004 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._enter() Oct 28 19:00:41.690004 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 19:00:41.690004 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 19:00:41.690779 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 19:00:41.690779 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.creator() Oct 28 19:00:41.690779 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 19:00:41.690779 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application created_value = creator( Oct 28 19:00:41.690779 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 28 19:00:41.690779 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 28 19:00:41.690779 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 28 19:00:41.690779 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 28 19:00:41.690779 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 28 19:00:41.690779 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 28 19:00:41.690779 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 28 19:00:41.690779 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application Oct 28 19:00:41.690779 dv-cinder-862365-1-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 69/136] 10.222.0.23 () {56 vars in 1099 bytes} [Fri Oct 28 19:00:41 2022] GET /identity/v3/roles/reader => generated 84 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 19:00:41.697675 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48fb243-1711-40ca-a861-412b93525454 None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:00:41.804168 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48fb243-1711-40ca-a861-412b93525454 None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:00:41.847789 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1cc0b3-e138-4bdf-a9a8-ae80a4a9177a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:00:41.848553 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1cc0b3-e138-4bdf-a9a8-ae80a4a9177a None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:00:41.848834 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1cc0b3-e138-4bdf-a9a8-ae80a4a9177a None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:00:41.849113 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1cc0b3-e138-4bdf-a9a8-ae80a4a9177a None admin] PATH_INFO: `/v3/roles` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:00:41.849822 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1cc0b3-e138-4bdf-a9a8-ae80a4a9177a None admin] RBAC: Adding query filter params (name=reader) {{(pid=81766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:00:41.850132 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1cc0b3-e138-4bdf-a9a8-ae80a4a9177a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:00:41.851501 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1cc0b3-e138-4bdf-a9a8-ae80a4a9177a None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:00:41.853083 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:00:41.861820 dv-cinder-862365-1-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 68/137] 10.222.0.23 () {56 vars in 1101 bytes} [Fri Oct 28 19:00:41 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:00:41.868155 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef86575-02c1-44f1-8741-3884c7b08d9b None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:00:41.984966 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef86575-02c1-44f1-8741-3884c7b08d9b None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:00:42.017159 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:00:42.022761 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3166a7-f39f-4343-b2f3-de78cd6c89a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:00:42.023589 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3166a7-f39f-4343-b2f3-de78cd6c89a0 None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:00:42.024051 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3166a7-f39f-4343-b2f3-de78cd6c89a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:00:42.024472 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3166a7-f39f-4343-b2f3-de78cd6c89a0 None admin] PATH_INFO: `/v3/users/777c5f75640640b69050e41779968d53` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:00:42.025902 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3166a7-f39f-4343-b2f3-de78cd6c89a0 None admin] RBAC: Authorizing `identity:get_user(user_id=777c5f75640640b69050e41779968d53)` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:00:42.027542 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3166a7-f39f-4343-b2f3-de78cd6c89a0 None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:00:42.029626 dv-cinder-862365-1-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 70/138] 10.222.0.23 () {56 vars in 1177 bytes} [Fri Oct 28 19:00:41 2022] GET /identity/v3/users/777c5f75640640b69050e41779968d53 => generated 289 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:00:42.035041 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1cc0b3-e138-4bdf-a9a8-ae80a4a9177a None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:00:42.138608 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1cc0b3-e138-4bdf-a9a8-ae80a4a9177a None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:00:42.179446 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd6a388-fbf3-49a2-973b-131f07961708 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:00:42.180067 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd6a388-fbf3-49a2-973b-131f07961708 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:00:42.180353 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd6a388-fbf3-49a2-973b-131f07961708 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:00:42.180633 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd6a388-fbf3-49a2-973b-131f07961708 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:00:42.244359 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:00:42.251397 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd6a388-fbf3-49a2-973b-131f07961708 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:00:42.252868 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd6a388-fbf3-49a2-973b-131f07961708 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:00:42.355734 dv-cinder-862365-1-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 69/139] 10.222.0.23 () {58 vars in 1282 bytes} [Fri Oct 28 19:00:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 28 19:00:42.361419 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3166a7-f39f-4343-b2f3-de78cd6c89a0 None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:00:42.470022 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3166a7-f39f-4343-b2f3-de78cd6c89a0 None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:00:42.507247 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49716967-39e5-4453-9c16-fc6c916df4f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:00:42.508109 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49716967-39e5-4453-9c16-fc6c916df4f8 None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:00:42.508533 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49716967-39e5-4453-9c16-fc6c916df4f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:00:42.508972 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49716967-39e5-4453-9c16-fc6c916df4f8 None admin] PATH_INFO: `/v3/projects/575e6206099b4a24bc9b829f3e7b6bdc` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:00:42.510285 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49716967-39e5-4453-9c16-fc6c916df4f8 None admin] RBAC: Authorizing `identity:get_project(project_id=575e6206099b4a24bc9b829f3e7b6bdc)` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:00:42.512437 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49716967-39e5-4453-9c16-fc6c916df4f8 None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:00:42.514831 dv-cinder-862365-1-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 71/140] 10.222.0.23 () {56 vars in 1186 bytes} [Fri Oct 28 19:00:42 2022] GET /identity/v3/projects/575e6206099b4a24bc9b829f3e7b6bdc => generated 298 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:00:42.522441 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd6a388-fbf3-49a2-973b-131f07961708 None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:00:42.618798 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:00:42.625147 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd6a388-fbf3-49a2-973b-131f07961708 None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:00:42.662732 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d719446-33ad-4659-a549-37f85453a652 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:00:42.663350 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d719446-33ad-4659-a549-37f85453a652 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:00:42.663639 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d719446-33ad-4659-a549-37f85453a652 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:00:42.663931 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d719446-33ad-4659-a549-37f85453a652 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:00:42.664671 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d719446-33ad-4659-a549-37f85453a652 None admin] RBAC: Adding query filter params (role.id=ba7a86f4918e49709c1bae8d5942bf42, scope.project.id=575e6206099b4a24bc9b829f3e7b6bdc, user.id=777c5f75640640b69050e41779968d53) {{(pid=81766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:00:42.665205 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d719446-33ad-4659-a549-37f85453a652 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:00:42.666941 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d719446-33ad-4659-a549-37f85453a652 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:00:42.673064 dv-cinder-862365-1-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 70/141] 10.222.0.23 () {56 vars in 1374 bytes} [Fri Oct 28 19:00:42 2022] GET /identity/v3/role_assignments?user.id=777c5f75640640b69050e41779968d53&scope.project.id=575e6206099b4a24bc9b829f3e7b6bdc&role.id=ba7a86f4918e49709c1bae8d5942bf42 => generated 608 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:00:43.761617 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21060044-46fd-4756-99d1-58fe6bf05cf3 None None] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:00:43.762132 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21060044-46fd-4756-99d1-58fe6bf05cf3 None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:00:43.762206 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21060044-46fd-4756-99d1-58fe6bf05cf3 None None] PATH_INFO: `/` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:00:43.763553 dv-cinder-862365-1-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 72/142] 10.222.0.23 () {54 vars in 927 bytes} [Fri Oct 28 19:00:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 19:00:43.768570 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a22cb7a-cc76-43a1-94cb-61d2640cfc6f None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:00:43.768969 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a22cb7a-cc76-43a1-94cb-61d2640cfc6f None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:00:43.769130 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a22cb7a-cc76-43a1-94cb-61d2640cfc6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:00:43.788962 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-8a22cb7a-cc76-43a1-94cb-61d2640cfc6f None None] MFA Rules not processed for user `ae863915635746d1ac19970949de4722`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:00:43.790237 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-8a22cb7a-cc76-43a1-94cb-61d2640cfc6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:00:43.903287 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9b70dc-a66f-47f2-a9a9-da633e3b25e9 None None] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:00:43.903570 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9b70dc-a66f-47f2-a9a9-da633e3b25e9 None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:00:43.903847 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9b70dc-a66f-47f2-a9a9-da633e3b25e9 None None] PATH_INFO: `/` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:00:43.905170 dv-cinder-862365-1-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 73/143] 10.222.0.23 () {54 vars in 927 bytes} [Fri Oct 28 19:00:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 28 19:00:43.908686 dv-cinder-862365-1-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 71/144] 10.222.0.23 () {58 vars in 1024 bytes} [Fri Oct 28 19:00:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 28 19:00:43.910811 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c739a96-677b-40b7-9ba0-13e0f7e7d515 None None] REQUEST_METHOD: `POST` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:00:43.911101 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c739a96-677b-40b7-9ba0-13e0f7e7d515 None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:00:43.911375 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c739a96-677b-40b7-9ba0-13e0f7e7d515 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:00:43.929324 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.auth.core [None req-4c739a96-677b-40b7-9ba0-13e0f7e7d515 None None] MFA Rules not processed for user `ae863915635746d1ac19970949de4722`. Rule list: `[]` (Enabled: `True`). {{(pid=81765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:00:43.930561 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-4c739a96-677b-40b7-9ba0-13e0f7e7d515 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:00:43.997793 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:00:44.003587 dv-cinder-862365-1-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 74/145] 10.222.0.23 () {58 vars in 1024 bytes} [Fri Oct 28 19:00:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 28 19:00:44.057372 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef389263-cf0a-4774-8396-885345757dad None None] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:00:44.057649 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef389263-cf0a-4774-8396-885345757dad None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:00:44.058404 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef389263-cf0a-4774-8396-885345757dad None None] PATH_INFO: `/` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:00:44.059945 dv-cinder-862365-1-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 72/146] 10.222.0.23 () {54 vars in 927 bytes} [Fri Oct 28 19:00:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 19:00:44.064849 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e1a902-1bbd-4b5c-aee8-f3020e42a98b None None] REQUEST_METHOD: `POST` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:00:44.065190 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e1a902-1bbd-4b5c-aee8-f3020e42a98b None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:00:44.065484 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e1a902-1bbd-4b5c-aee8-f3020e42a98b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:00:44.084154 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.auth.core [None req-21e1a902-1bbd-4b5c-aee8-f3020e42a98b None None] MFA Rules not processed for user `ae863915635746d1ac19970949de4722`. Rule list: `[]` (Enabled: `True`). {{(pid=81765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:00:44.085333 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-21e1a902-1bbd-4b5c-aee8-f3020e42a98b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:00:44.155489 dv-cinder-862365-1-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 75/147] 10.222.0.23 () {58 vars in 1024 bytes} [Fri Oct 28 19:00:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 28 19:00:44.174554 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef389263-cf0a-4774-8396-885345757dad None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:00:44.265991 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e1a902-1bbd-4b5c-aee8-f3020e42a98b None None] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:00:44.269916 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:00:44.281479 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef389263-cf0a-4774-8396-885345757dad None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:00:44.319429 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780da30e-5a52-4d6f-9def-7640dfe914cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:00:44.320847 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780da30e-5a52-4d6f-9def-7640dfe914cb None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:00:44.321623 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780da30e-5a52-4d6f-9def-7640dfe914cb None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:00:44.322085 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780da30e-5a52-4d6f-9def-7640dfe914cb None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:00:44.336124 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780da30e-5a52-4d6f-9def-7640dfe914cb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 19:00:44.342779 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application [None req-780da30e-5a52-4d6f-9def-7640dfe914cb None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 28 19:00:44.342779 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 19:00:44.342779 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 19:00:44.342779 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 19:00:44.342779 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 19:00:44.342779 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 19:00:44.342779 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 19:00:44.342779 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 19:00:44.342779 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 19:00:44.342779 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 19:00:44.342779 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 19:00:44.342779 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 19:00:44.342779 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 28 19:00:44.342779 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 28 19:00:44.342779 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 28 19:00:44.342779 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 28 19:00:44.343783 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 28 19:00:44.343783 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 28 19:00:44.343783 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 28 19:00:44.343783 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 28 19:00:44.343783 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 19:00:44.343783 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 19:00:44.343783 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 19:00:44.343783 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 19:00:44.343783 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 19:00:44.343783 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 19:00:44.343783 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 19:00:44.343783 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application with Lock( Oct 28 19:00:44.343783 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 19:00:44.343783 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._enter() Oct 28 19:00:44.343783 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 19:00:44.343783 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 19:00:44.344627 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 19:00:44.344627 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.creator() Oct 28 19:00:44.344627 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 19:00:44.344627 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application created_value = creator( Oct 28 19:00:44.344627 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 28 19:00:44.344627 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 28 19:00:44.344627 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 28 19:00:44.344627 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 28 19:00:44.344627 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 28 19:00:44.344627 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 28 19:00:44.344627 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 28 19:00:44.344627 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Oct 28 19:00:44.349723 dv-cinder-862365-1-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 73/148] 10.222.0.23 () {56 vars in 1096 bytes} [Fri Oct 28 19:00:44 2022] GET /identity/v3/roles/admin => generated 83 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 19:00:44.350480 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780da30e-5a52-4d6f-9def-7640dfe914cb None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:00:44.369008 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e1a902-1bbd-4b5c-aee8-f3020e42a98b None None] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:00:44.396500 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:00:44.405170 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7dadbb1-4181-4ee6-ba4b-60f327f2c1c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:00:44.406251 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7dadbb1-4181-4ee6-ba4b-60f327f2c1c3 None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:00:44.406531 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7dadbb1-4181-4ee6-ba4b-60f327f2c1c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:00:44.409263 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7dadbb1-4181-4ee6-ba4b-60f327f2c1c3 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:00:44.416893 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7dadbb1-4181-4ee6-ba4b-60f327f2c1c3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 19:00:44.422710 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application [None req-e7dadbb1-4181-4ee6-ba4b-60f327f2c1c3 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 28 19:00:44.422710 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 19:00:44.422710 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 19:00:44.422710 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 19:00:44.422710 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 19:00:44.422710 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 19:00:44.422710 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 19:00:44.422710 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 19:00:44.422710 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 19:00:44.422710 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 19:00:44.422710 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 19:00:44.422710 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 19:00:44.422710 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 28 19:00:44.422710 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 28 19:00:44.422710 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 28 19:00:44.422710 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 28 19:00:44.423827 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 28 19:00:44.423827 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 28 19:00:44.423827 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 28 19:00:44.423827 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 28 19:00:44.423827 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 19:00:44.423827 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 19:00:44.423827 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 19:00:44.423827 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 19:00:44.423827 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 19:00:44.423827 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 19:00:44.423827 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 19:00:44.423827 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application with Lock( Oct 28 19:00:44.423827 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 19:00:44.423827 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._enter() Oct 28 19:00:44.423827 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 19:00:44.423827 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 19:00:44.424859 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 19:00:44.424859 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.creator() Oct 28 19:00:44.424859 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 19:00:44.424859 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application created_value = creator( Oct 28 19:00:44.424859 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 28 19:00:44.424859 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 28 19:00:44.424859 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 28 19:00:44.424859 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 28 19:00:44.424859 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 28 19:00:44.424859 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 28 19:00:44.424859 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 28 19:00:44.424859 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application Oct 28 19:00:44.426042 dv-cinder-862365-1-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 76/149] 10.222.0.23 () {56 vars in 1114 bytes} [Fri Oct 28 19:00:44 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 28 19:00:44.426819 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7dadbb1-4181-4ee6-ba4b-60f327f2c1c3 None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:00:44.457058 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780da30e-5a52-4d6f-9def-7640dfe914cb None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:00:44.491114 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3102aa5c-9463-455d-a94a-23cb563b25ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:00:44.491720 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3102aa5c-9463-455d-a94a-23cb563b25ed None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:00:44.492002 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3102aa5c-9463-455d-a94a-23cb563b25ed None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:00:44.492273 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3102aa5c-9463-455d-a94a-23cb563b25ed None admin] PATH_INFO: `/v3/roles` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:00:44.492927 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3102aa5c-9463-455d-a94a-23cb563b25ed None admin] RBAC: Adding query filter params (name=admin) {{(pid=81766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:00:44.493231 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3102aa5c-9463-455d-a94a-23cb563b25ed None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:00:44.494634 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3102aa5c-9463-455d-a94a-23cb563b25ed None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:00:44.503194 dv-cinder-862365-1-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 74/150] 10.222.0.23 () {56 vars in 1099 bytes} [Fri Oct 28 19:00:44 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 19:00:44.504047 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3102aa5c-9463-455d-a94a-23cb563b25ed None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:00:44.518074 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:00:44.529152 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7dadbb1-4181-4ee6-ba4b-60f327f2c1c3 None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:00:44.563607 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a776f55d-0f9b-4758-9a78-ec8e649e641f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:00:44.564360 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a776f55d-0f9b-4758-9a78-ec8e649e641f None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:00:44.564643 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a776f55d-0f9b-4758-9a78-ec8e649e641f None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:00:44.564918 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a776f55d-0f9b-4758-9a78-ec8e649e641f None admin] PATH_INFO: `/v3/domains/default` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:00:44.566052 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a776f55d-0f9b-4758-9a78-ec8e649e641f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:00:44.567492 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a776f55d-0f9b-4758-9a78-ec8e649e641f None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:00:44.569066 dv-cinder-862365-1-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 77/151] 10.222.0.23 () {56 vars in 1108 bytes} [Fri Oct 28 19:00:44 2022] GET /identity/v3/domains/default => generated 199 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:00:44.569910 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a776f55d-0f9b-4758-9a78-ec8e649e641f None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:00:44.602693 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3102aa5c-9463-455d-a94a-23cb563b25ed None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:00:44.625684 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:00:44.635913 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f14395c-0bac-4643-bf1e-196649f2e4cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:00:44.636538 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f14395c-0bac-4643-bf1e-196649f2e4cc None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:00:44.636824 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f14395c-0bac-4643-bf1e-196649f2e4cc None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:00:44.637100 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f14395c-0bac-4643-bf1e-196649f2e4cc None admin] PATH_INFO: `/v3/roles` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:00:44.637800 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f14395c-0bac-4643-bf1e-196649f2e4cc None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:00:44.638113 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f14395c-0bac-4643-bf1e-196649f2e4cc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:00:44.639491 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f14395c-0bac-4643-bf1e-196649f2e4cc None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:00:44.647223 dv-cinder-862365-1-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 75/152] 10.222.0.23 () {56 vars in 1111 bytes} [Fri Oct 28 19:00:44 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:00:44.647957 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f14395c-0bac-4643-bf1e-196649f2e4cc None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:00:44.668783 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a776f55d-0f9b-4758-9a78-ec8e649e641f None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:00:44.702060 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc41526-65cf-4d94-94e6-4bf09c6aaeef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:00:44.702677 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc41526-65cf-4d94-94e6-4bf09c6aaeef None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:00:44.702947 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc41526-65cf-4d94-94e6-4bf09c6aaeef None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:00:44.703213 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc41526-65cf-4d94-94e6-4bf09c6aaeef None admin] PATH_INFO: `/v3/users/56bca2bbd2d2444db9b75331d5fa6002` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:00:44.717376 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc41526-65cf-4d94-94e6-4bf09c6aaeef None admin] RBAC: Authorizing `identity:get_user(user_id=56bca2bbd2d2444db9b75331d5fa6002)` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:00:44.719782 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc41526-65cf-4d94-94e6-4bf09c6aaeef None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:00:44.725870 dv-cinder-862365-1-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 78/153] 10.222.0.23 () {56 vars in 1177 bytes} [Fri Oct 28 19:00:44 2022] GET /identity/v3/users/56bca2bbd2d2444db9b75331d5fa6002 => generated 283 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:00:44.725870 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc41526-65cf-4d94-94e6-4bf09c6aaeef None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:00:44.726064 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:00:44.750001 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f14395c-0bac-4643-bf1e-196649f2e4cc None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:00:44.784169 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75394e2-7732-4733-9b02-99001b64833f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:00:44.784783 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75394e2-7732-4733-9b02-99001b64833f None admin] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:00:44.785039 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75394e2-7732-4733-9b02-99001b64833f None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:00:44.785317 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75394e2-7732-4733-9b02-99001b64833f None admin] PATH_INFO: `/v3/users` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:00:44.785991 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75394e2-7732-4733-9b02-99001b64833f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:00:44.787446 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75394e2-7732-4733-9b02-99001b64833f None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:00:44.819088 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc41526-65cf-4d94-94e6-4bf09c6aaeef None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:00:44.832920 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:00:44.853073 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6672b89-eee8-455a-9f6d-34b6c17fc57a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:00:44.853730 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6672b89-eee8-455a-9f6d-34b6c17fc57a None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:00:44.854014 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6672b89-eee8-455a-9f6d-34b6c17fc57a None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:00:44.854287 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6672b89-eee8-455a-9f6d-34b6c17fc57a None admin] PATH_INFO: `/v3/users/56bca2bbd2d2444db9b75331d5fa6002` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:00:44.856042 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6672b89-eee8-455a-9f6d-34b6c17fc57a None admin] RBAC: Authorizing `identity:get_user(user_id=56bca2bbd2d2444db9b75331d5fa6002)` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:00:44.857519 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6672b89-eee8-455a-9f6d-34b6c17fc57a None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:00:44.859130 dv-cinder-862365-1-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 79/154] 10.222.0.23 () {56 vars in 1177 bytes} [Fri Oct 28 19:00:44 2022] GET /identity/v3/users/56bca2bbd2d2444db9b75331d5fa6002 => generated 283 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:00:44.859999 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6672b89-eee8-455a-9f6d-34b6c17fc57a None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:00:44.923189 dv-cinder-862365-1-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 76/155] 10.222.0.23 () {60 vars in 1132 bytes} [Fri Oct 28 19:00:44 2022] POST /identity/v3/users => generated 297 bytes in 275 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 19:00:44.924053 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75394e2-7732-4733-9b02-99001b64833f None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:00:44.959384 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6672b89-eee8-455a-9f6d-34b6c17fc57a None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:00:45.001750 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9d12bc-4fcb-4772-83e9-5f324caad8c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:00:45.002404 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9d12bc-4fcb-4772-83e9-5f324caad8c8 None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:00:45.002751 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9d12bc-4fcb-4772-83e9-5f324caad8c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:00:45.003030 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9d12bc-4fcb-4772-83e9-5f324caad8c8 None admin] PATH_INFO: `/v3/projects/0e59baa74fa1427ab5e2f47d5fb1e4c7` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:00:45.004240 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9d12bc-4fcb-4772-83e9-5f324caad8c8 None admin] RBAC: Authorizing `identity:get_project(project_id=0e59baa74fa1427ab5e2f47d5fb1e4c7)` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:00:45.005756 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9d12bc-4fcb-4772-83e9-5f324caad8c8 None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:00:45.007509 dv-cinder-862365-1-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 80/156] 10.222.0.23 () {56 vars in 1186 bytes} [Fri Oct 28 19:00:44 2022] GET /identity/v3/projects/0e59baa74fa1427ab5e2f47d5fb1e4c7 => generated 302 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:00:45.013589 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9d12bc-4fcb-4772-83e9-5f324caad8c8 None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:00:45.052969 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75394e2-7732-4733-9b02-99001b64833f None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:00:45.067589 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:00:45.084186 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:00:45.091167 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3876997a-f942-4870-bff0-488998e568d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:00:45.091934 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3876997a-f942-4870-bff0-488998e568d1 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:00:45.092291 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3876997a-f942-4870-bff0-488998e568d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:00:45.092557 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3876997a-f942-4870-bff0-488998e568d1 None admin] PATH_INFO: `/v3/projects/0e59baa74fa1427ab5e2f47d5fb1e4c7` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:00:45.094092 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3876997a-f942-4870-bff0-488998e568d1 None admin] RBAC: Authorizing `identity:get_project(project_id=0e59baa74fa1427ab5e2f47d5fb1e4c7)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:00:45.095570 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3876997a-f942-4870-bff0-488998e568d1 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:00:45.097237 dv-cinder-862365-1-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 77/157] 10.222.0.23 () {56 vars in 1186 bytes} [Fri Oct 28 19:00:44 2022] GET /identity/v3/projects/0e59baa74fa1427ab5e2f47d5fb1e4c7 => generated 302 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:00:45.103644 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3876997a-f942-4870-bff0-488998e568d1 None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:00:45.129277 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9d12bc-4fcb-4772-83e9-5f324caad8c8 None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:00:45.173009 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64c445e-ba40-4ff9-8bf1-bbe041dccba1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:00:45.173716 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64c445e-ba40-4ff9-8bf1-bbe041dccba1 None admin] REQUEST_METHOD: `PUT` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:00:45.173995 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64c445e-ba40-4ff9-8bf1-bbe041dccba1 None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:00:45.174267 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64c445e-ba40-4ff9-8bf1-bbe041dccba1 None admin] PATH_INFO: `/v3/projects/0e59baa74fa1427ab5e2f47d5fb1e4c7/users/56bca2bbd2d2444db9b75331d5fa6002/roles/a9e4e47c2bf448fcbada91c1174644f7` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:00:45.176203 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64c445e-ba40-4ff9-8bf1-bbe041dccba1 None admin] RBAC: Authorizing `identity:create_grant(project_id=0e59baa74fa1427ab5e2f47d5fb1e4c7, user_id=56bca2bbd2d2444db9b75331d5fa6002, role_id=a9e4e47c2bf448fcbada91c1174644f7)` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:00:45.177661 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64c445e-ba40-4ff9-8bf1-bbe041dccba1 None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:00:45.227395 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3876997a-f942-4870-bff0-488998e568d1 None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:00:45.265406 dv-cinder-862365-1-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 81/158] 10.222.0.23 () {58 vars in 1439 bytes} [Fri Oct 28 19:00:45 2022] PUT /identity/v3/projects/0e59baa74fa1427ab5e2f47d5fb1e4c7/users/56bca2bbd2d2444db9b75331d5fa6002/roles/a9e4e47c2bf448fcbada91c1174644f7 => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 19:00:45.275764 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a7df59-6511-4c26-a556-3773b704d07b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:00:45.276461 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a7df59-6511-4c26-a556-3773b704d07b None admin] REQUEST_METHOD: `PUT` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:00:45.277333 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a7df59-6511-4c26-a556-3773b704d07b None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:00:45.277668 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a7df59-6511-4c26-a556-3773b704d07b None admin] PATH_INFO: `/v3/projects/0e59baa74fa1427ab5e2f47d5fb1e4c7/users/56bca2bbd2d2444db9b75331d5fa6002/roles/a11a1b300fe044b5a905284bc623dc41` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:00:45.279959 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a7df59-6511-4c26-a556-3773b704d07b None admin] RBAC: Authorizing `identity:create_grant(project_id=0e59baa74fa1427ab5e2f47d5fb1e4c7, user_id=56bca2bbd2d2444db9b75331d5fa6002, role_id=a11a1b300fe044b5a905284bc623dc41)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:00:45.281505 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a7df59-6511-4c26-a556-3773b704d07b None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:00:45.363684 dv-cinder-862365-1-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 78/159] 10.222.0.23 () {58 vars in 1439 bytes} [Fri Oct 28 19:00:45 2022] PUT /identity/v3/projects/0e59baa74fa1427ab5e2f47d5fb1e4c7/users/56bca2bbd2d2444db9b75331d5fa6002/roles/a11a1b300fe044b5a905284bc623dc41 => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 19:00:47.203368 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1037d0b-a674-4c6e-be8e-210a1de78438 None None] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:00:47.203866 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1037d0b-a674-4c6e-be8e-210a1de78438 None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:00:47.203866 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1037d0b-a674-4c6e-be8e-210a1de78438 None None] PATH_INFO: `/` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:00:47.205229 dv-cinder-862365-1-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 82/160] 10.222.0.23 () {54 vars in 927 bytes} [Fri Oct 28 19:00:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 19:00:47.211202 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e68030-1afb-49cb-aa5e-991221dc4a06 None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:00:47.211681 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e68030-1afb-49cb-aa5e-991221dc4a06 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:00:47.211754 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e68030-1afb-49cb-aa5e-991221dc4a06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:00:47.231409 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-f4e68030-1afb-49cb-aa5e-991221dc4a06 None None] MFA Rules not processed for user `ae863915635746d1ac19970949de4722`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:00:47.233205 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-f4e68030-1afb-49cb-aa5e-991221dc4a06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:00:47.300030 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:00:47.305885 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0848c92-4a33-420e-bf75-cf758ad79f23 None None] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:00:47.306171 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0848c92-4a33-420e-bf75-cf758ad79f23 None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:00:47.306518 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0848c92-4a33-420e-bf75-cf758ad79f23 None None] PATH_INFO: `/` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:00:47.307884 dv-cinder-862365-1-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 83/161] 10.222.0.23 () {54 vars in 927 bytes} [Fri Oct 28 19:00:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 28 19:00:47.313594 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5767d3fa-0bfd-4e78-bc73-7547eb57f2e7 None None] REQUEST_METHOD: `POST` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:00:47.313883 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5767d3fa-0bfd-4e78-bc73-7547eb57f2e7 None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:00:47.314153 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5767d3fa-0bfd-4e78-bc73-7547eb57f2e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:00:47.317530 dv-cinder-862365-1-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 79/162] 10.222.0.23 () {58 vars in 1024 bytes} [Fri Oct 28 19:00:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 28 19:00:47.337892 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.auth.core [None req-5767d3fa-0bfd-4e78-bc73-7547eb57f2e7 None None] MFA Rules not processed for user `ae863915635746d1ac19970949de4722`. Rule list: `[]` (Enabled: `True`). {{(pid=81765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:00:47.339973 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-5767d3fa-0bfd-4e78-bc73-7547eb57f2e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:00:47.409751 dv-cinder-862365-1-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 84/163] 10.222.0.23 () {58 vars in 1024 bytes} [Fri Oct 28 19:00:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 28 19:00:47.445937 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3d033d-0d59-4c8e-ad19-7c4bfe44de47 None None] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:00:47.446220 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3d033d-0d59-4c8e-ad19-7c4bfe44de47 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:00:47.446496 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3d033d-0d59-4c8e-ad19-7c4bfe44de47 None None] PATH_INFO: `/` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:00:47.447866 dv-cinder-862365-1-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 80/164] 10.222.0.23 () {54 vars in 927 bytes} [Fri Oct 28 19:00:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 19:00:47.454142 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb95df1-f426-4135-ba2a-93a6b684b06f None None] REQUEST_METHOD: `POST` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:00:47.454378 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb95df1-f426-4135-ba2a-93a6b684b06f None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:00:47.454609 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb95df1-f426-4135-ba2a-93a6b684b06f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:00:47.475076 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.auth.core [None req-abb95df1-f426-4135-ba2a-93a6b684b06f None None] MFA Rules not processed for user `ae863915635746d1ac19970949de4722`. Rule list: `[]` (Enabled: `True`). {{(pid=81765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:00:47.476283 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-abb95df1-f426-4135-ba2a-93a6b684b06f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:00:47.517938 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:00:47.551515 dv-cinder-862365-1-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 85/165] 10.222.0.23 () {58 vars in 1024 bytes} [Fri Oct 28 19:00:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 28 19:00:47.577797 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df5fe95-5995-4472-8387-00857f88694b None None] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:00:47.578081 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df5fe95-5995-4472-8387-00857f88694b None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:00:47.578356 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df5fe95-5995-4472-8387-00857f88694b None None] PATH_INFO: `/` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:00:47.579734 dv-cinder-862365-1-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 81/166] 10.222.0.23 () {54 vars in 927 bytes} [Fri Oct 28 19:00:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 19:00:47.584913 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b914f8-d629-4227-8c10-7dbee9ef89f4 None None] REQUEST_METHOD: `POST` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:00:47.585196 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b914f8-d629-4227-8c10-7dbee9ef89f4 None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:00:47.585755 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b914f8-d629-4227-8c10-7dbee9ef89f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:00:47.604815 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.auth.core [None req-01b914f8-d629-4227-8c10-7dbee9ef89f4 None None] MFA Rules not processed for user `ae863915635746d1ac19970949de4722`. Rule list: `[]` (Enabled: `True`). {{(pid=81765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:00:47.606007 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-01b914f8-d629-4227-8c10-7dbee9ef89f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:00:47.620867 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df5fe95-5995-4472-8387-00857f88694b None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:00:47.686594 dv-cinder-862365-1-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 86/167] 10.222.0.23 () {58 vars in 1024 bytes} [Fri Oct 28 19:00:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 28 19:00:47.702511 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b914f8-d629-4227-8c10-7dbee9ef89f4 None None] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:00:47.746886 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df5fe95-5995-4472-8387-00857f88694b None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:00:47.791665 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d24ff7-b822-4f3f-963d-809619fee594 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:00:47.792655 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d24ff7-b822-4f3f-963d-809619fee594 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:00:47.793126 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d24ff7-b822-4f3f-963d-809619fee594 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:00:47.794133 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d24ff7-b822-4f3f-963d-809619fee594 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:00:47.803572 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:00:47.806558 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b914f8-d629-4227-8c10-7dbee9ef89f4 None None] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:00:47.809626 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d24ff7-b822-4f3f-963d-809619fee594 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 19:00:47.816061 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application [None req-b1d24ff7-b822-4f3f-963d-809619fee594 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 28 19:00:47.816061 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 19:00:47.816061 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 19:00:47.816061 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 19:00:47.816061 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 19:00:47.816061 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 19:00:47.816061 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 19:00:47.816061 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 19:00:47.816061 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 19:00:47.816061 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 19:00:47.816061 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 19:00:47.816061 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 19:00:47.816061 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 28 19:00:47.816061 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 28 19:00:47.816061 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 28 19:00:47.816061 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 28 19:00:47.818285 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 28 19:00:47.818285 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 28 19:00:47.818285 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 28 19:00:47.818285 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 28 19:00:47.818285 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 19:00:47.818285 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 19:00:47.818285 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 19:00:47.818285 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 19:00:47.818285 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 19:00:47.818285 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 19:00:47.818285 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 19:00:47.818285 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application with Lock( Oct 28 19:00:47.818285 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 19:00:47.818285 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._enter() Oct 28 19:00:47.818285 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 19:00:47.818285 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 19:00:47.819255 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 19:00:47.819255 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.creator() Oct 28 19:00:47.819255 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 19:00:47.819255 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application created_value = creator( Oct 28 19:00:47.819255 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 28 19:00:47.819255 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 28 19:00:47.819255 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 28 19:00:47.819255 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 28 19:00:47.819255 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 28 19:00:47.819255 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 28 19:00:47.819255 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 28 19:00:47.819255 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Oct 28 19:00:47.820859 dv-cinder-862365-1-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 82/168] 10.222.0.23 () {56 vars in 1099 bytes} [Fri Oct 28 19:00:47 2022] GET /identity/v3/roles/member => generated 84 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 28 19:00:47.829470 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d24ff7-b822-4f3f-963d-809619fee594 None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:00:47.852207 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac521c9-32e5-41eb-8b13-58df7f4574a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:00:47.852849 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac521c9-32e5-41eb-8b13-58df7f4574a4 None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:00:47.853307 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac521c9-32e5-41eb-8b13-58df7f4574a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:00:47.853551 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac521c9-32e5-41eb-8b13-58df7f4574a4 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:00:47.854683 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac521c9-32e5-41eb-8b13-58df7f4574a4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:00:47.856683 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac521c9-32e5-41eb-8b13-58df7f4574a4 None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:00:47.861392 dv-cinder-862365-1-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 87/169] 10.222.0.23 () {56 vars in 1108 bytes} [Fri Oct 28 19:00:47 2022] GET /identity/v3/domains/default => generated 199 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:00:47.861392 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac521c9-32e5-41eb-8b13-58df7f4574a4 None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:00:47.887770 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:00:47.941774 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d24ff7-b822-4f3f-963d-809619fee594 None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:00:47.966060 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac521c9-32e5-41eb-8b13-58df7f4574a4 None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:00:47.979505 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553c3f3c-7b3d-4ef9-b67d-7c98c8e2d88b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:00:47.980691 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553c3f3c-7b3d-4ef9-b67d-7c98c8e2d88b None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:00:47.980976 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553c3f3c-7b3d-4ef9-b67d-7c98c8e2d88b None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:00:47.981251 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553c3f3c-7b3d-4ef9-b67d-7c98c8e2d88b None admin] PATH_INFO: `/v3/roles` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:00:47.981940 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-553c3f3c-7b3d-4ef9-b67d-7c98c8e2d88b None admin] RBAC: Adding query filter params (name=member) {{(pid=81766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:00:47.982244 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-553c3f3c-7b3d-4ef9-b67d-7c98c8e2d88b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:00:47.983615 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-553c3f3c-7b3d-4ef9-b67d-7c98c8e2d88b None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:00:47.991468 dv-cinder-862365-1-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 83/170] 10.222.0.23 () {56 vars in 1101 bytes} [Fri Oct 28 19:00:47 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 19:00:47.992238 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553c3f3c-7b3d-4ef9-b67d-7c98c8e2d88b None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:00:48.005128 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526cd59e-1646-413c-bd56-bc673a693222 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:00:48.005719 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526cd59e-1646-413c-bd56-bc673a693222 None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:00:48.006005 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526cd59e-1646-413c-bd56-bc673a693222 None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:00:48.006281 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526cd59e-1646-413c-bd56-bc673a693222 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:00:48.018792 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526cd59e-1646-413c-bd56-bc673a693222 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 19:00:48.023664 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application [None req-526cd59e-1646-413c-bd56-bc673a693222 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 28 19:00:48.023664 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 19:00:48.023664 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 19:00:48.023664 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 19:00:48.023664 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 19:00:48.023664 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 19:00:48.023664 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 19:00:48.023664 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 19:00:48.023664 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 19:00:48.023664 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 19:00:48.023664 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 19:00:48.023664 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 19:00:48.023664 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 28 19:00:48.023664 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 28 19:00:48.023664 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 28 19:00:48.023664 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 28 19:00:48.024578 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 28 19:00:48.024578 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 28 19:00:48.024578 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 28 19:00:48.024578 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 28 19:00:48.024578 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 19:00:48.024578 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 19:00:48.024578 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 19:00:48.024578 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 19:00:48.024578 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 19:00:48.024578 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 19:00:48.024578 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 19:00:48.024578 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application with Lock( Oct 28 19:00:48.024578 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 19:00:48.024578 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._enter() Oct 28 19:00:48.024578 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 19:00:48.024578 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 19:00:48.025378 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 19:00:48.025378 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.creator() Oct 28 19:00:48.025378 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 19:00:48.025378 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application created_value = creator( Oct 28 19:00:48.025378 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 28 19:00:48.025378 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 28 19:00:48.025378 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 28 19:00:48.025378 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 28 19:00:48.025378 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 28 19:00:48.025378 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 28 19:00:48.025378 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 28 19:00:48.025378 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application Oct 28 19:00:48.025378 dv-cinder-862365-1-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 88/171] 10.222.0.23 () {56 vars in 1096 bytes} [Fri Oct 28 19:00:47 2022] GET /identity/v3/roles/admin => generated 83 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 19:00:48.026045 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526cd59e-1646-413c-bd56-bc673a693222 None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:00:48.054169 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:00:48.095321 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553c3f3c-7b3d-4ef9-b67d-7c98c8e2d88b None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:00:48.106032 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:00:48.125804 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526cd59e-1646-413c-bd56-bc673a693222 None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:00:48.129990 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8a5347-9609-4e48-a1e9-f3ad9ab3a0ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:00:48.130588 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8a5347-9609-4e48-a1e9-f3ad9ab3a0ad None admin] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:00:48.130866 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8a5347-9609-4e48-a1e9-f3ad9ab3a0ad None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:00:48.131136 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8a5347-9609-4e48-a1e9-f3ad9ab3a0ad None admin] PATH_INFO: `/v3/users` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:00:48.131771 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8a5347-9609-4e48-a1e9-f3ad9ab3a0ad None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:00:48.133698 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8a5347-9609-4e48-a1e9-f3ad9ab3a0ad None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:00:48.159347 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b981a52-b74c-4ef7-9d46-df38b307f1c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:00:48.159974 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b981a52-b74c-4ef7-9d46-df38b307f1c5 None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:00:48.160342 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b981a52-b74c-4ef7-9d46-df38b307f1c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:00:48.160590 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b981a52-b74c-4ef7-9d46-df38b307f1c5 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:00:48.172090 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b981a52-b74c-4ef7-9d46-df38b307f1c5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 19:00:48.177041 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application [None req-4b981a52-b74c-4ef7-9d46-df38b307f1c5 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 28 19:00:48.177041 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 19:00:48.177041 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 19:00:48.177041 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 19:00:48.177041 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 19:00:48.177041 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 19:00:48.177041 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 19:00:48.177041 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 19:00:48.177041 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 19:00:48.177041 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 19:00:48.177041 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 19:00:48.177041 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 19:00:48.177041 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 28 19:00:48.177041 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 28 19:00:48.177041 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 28 19:00:48.177041 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 28 19:00:48.178113 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 28 19:00:48.178113 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 28 19:00:48.178113 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 28 19:00:48.178113 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 28 19:00:48.178113 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 19:00:48.178113 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 19:00:48.178113 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 19:00:48.178113 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 19:00:48.178113 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 19:00:48.178113 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 19:00:48.178113 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 19:00:48.178113 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application with Lock( Oct 28 19:00:48.178113 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 19:00:48.178113 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._enter() Oct 28 19:00:48.178113 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 19:00:48.178113 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 19:00:48.179029 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 19:00:48.179029 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.creator() Oct 28 19:00:48.179029 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 19:00:48.179029 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application created_value = creator( Oct 28 19:00:48.179029 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 28 19:00:48.179029 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 28 19:00:48.179029 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 28 19:00:48.179029 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 28 19:00:48.179029 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 28 19:00:48.179029 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 28 19:00:48.179029 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 28 19:00:48.179029 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application Oct 28 19:00:48.179029 dv-cinder-862365-1-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 89/172] 10.222.0.23 () {56 vars in 1114 bytes} [Fri Oct 28 19:00:48 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 19:00:48.179029 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b981a52-b74c-4ef7-9d46-df38b307f1c5 None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:00:48.208263 dv-cinder-862365-1-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 84/173] 10.222.0.23 () {60 vars in 1132 bytes} [Fri Oct 28 19:00:47 2022] POST /identity/v3/users => generated 297 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 19:00:48.209059 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8a5347-9609-4e48-a1e9-f3ad9ab3a0ad None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:00:48.280402 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:00:48.296037 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b981a52-b74c-4ef7-9d46-df38b307f1c5 None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:00:48.333864 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8a5347-9609-4e48-a1e9-f3ad9ab3a0ad None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:00:48.335254 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2407cf-0094-4a3d-9ba7-388a9789b32e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:00:48.336289 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2407cf-0094-4a3d-9ba7-388a9789b32e None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:00:48.336671 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2407cf-0094-4a3d-9ba7-388a9789b32e None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:00:48.336954 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2407cf-0094-4a3d-9ba7-388a9789b32e None admin] PATH_INFO: `/v3/users/89811646982e4955a993eb2f84ca845b` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:00:48.352079 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2407cf-0094-4a3d-9ba7-388a9789b32e None admin] RBAC: Authorizing `identity:get_user(user_id=89811646982e4955a993eb2f84ca845b)` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:00:48.353727 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2407cf-0094-4a3d-9ba7-388a9789b32e None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:00:48.356267 dv-cinder-862365-1-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 90/174] 10.222.0.23 () {56 vars in 1177 bytes} [Fri Oct 28 19:00:48 2022] GET /identity/v3/users/89811646982e4955a993eb2f84ca845b => generated 297 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:00:48.361767 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2407cf-0094-4a3d-9ba7-388a9789b32e None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:00:48.376095 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ca5e92-fcd5-46fa-9db4-0c08052c9438 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:00:48.377276 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ca5e92-fcd5-46fa-9db4-0c08052c9438 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:00:48.377276 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ca5e92-fcd5-46fa-9db4-0c08052c9438 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:00:48.377276 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ca5e92-fcd5-46fa-9db4-0c08052c9438 None admin] PATH_INFO: `/v3/roles` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:00:48.377948 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ca5e92-fcd5-46fa-9db4-0c08052c9438 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:00:48.378258 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ca5e92-fcd5-46fa-9db4-0c08052c9438 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:00:48.379640 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ca5e92-fcd5-46fa-9db4-0c08052c9438 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:00:48.389651 dv-cinder-862365-1-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 85/175] 10.222.0.23 () {56 vars in 1099 bytes} [Fri Oct 28 19:00:48 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:00:48.390267 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ca5e92-fcd5-46fa-9db4-0c08052c9438 None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:00:48.427163 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:00:48.482970 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2407cf-0094-4a3d-9ba7-388a9789b32e None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:00:48.515366 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ca5e92-fcd5-46fa-9db4-0c08052c9438 None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:00:48.523499 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387334e2-b61c-4b7f-90d7-e1d8e16e0273 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:00:48.524121 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387334e2-b61c-4b7f-90d7-e1d8e16e0273 None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:00:48.524407 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387334e2-b61c-4b7f-90d7-e1d8e16e0273 None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:00:48.524680 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387334e2-b61c-4b7f-90d7-e1d8e16e0273 None admin] PATH_INFO: `/v3/roles` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:00:48.525372 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387334e2-b61c-4b7f-90d7-e1d8e16e0273 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81765) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:00:48.525687 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387334e2-b61c-4b7f-90d7-e1d8e16e0273 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:00:48.527814 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387334e2-b61c-4b7f-90d7-e1d8e16e0273 None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:00:48.537143 dv-cinder-862365-1-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 91/176] 10.222.0.23 () {56 vars in 1111 bytes} [Fri Oct 28 19:00:48 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:00:48.538540 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387334e2-b61c-4b7f-90d7-e1d8e16e0273 None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:00:48.553809 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:00:48.564869 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3cf509-d8aa-4150-a594-3886c54183db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:00:48.564869 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3cf509-d8aa-4150-a594-3886c54183db None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:00:48.565137 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3cf509-d8aa-4150-a594-3886c54183db None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:00:48.565390 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3cf509-d8aa-4150-a594-3886c54183db None admin] PATH_INFO: `/v3/projects/0e59baa74fa1427ab5e2f47d5fb1e4c7` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:00:48.566600 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3cf509-d8aa-4150-a594-3886c54183db None admin] RBAC: Authorizing `identity:get_project(project_id=0e59baa74fa1427ab5e2f47d5fb1e4c7)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:00:48.568076 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3cf509-d8aa-4150-a594-3886c54183db None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:00:48.569764 dv-cinder-862365-1-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 86/177] 10.222.0.23 () {56 vars in 1186 bytes} [Fri Oct 28 19:00:48 2022] GET /identity/v3/projects/0e59baa74fa1427ab5e2f47d5fb1e4c7 => generated 302 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:00:48.570852 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3cf509-d8aa-4150-a594-3886c54183db None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:00:48.676896 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387334e2-b61c-4b7f-90d7-e1d8e16e0273 None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:00:48.680837 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3cf509-d8aa-4150-a594-3886c54183db None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:00:48.721883 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed261644-8469-4371-95b8-3c6a26b6456d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:00:48.722110 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6919a3-572c-4071-88ef-471c2387de0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:00:48.722511 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed261644-8469-4371-95b8-3c6a26b6456d None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:00:48.722617 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6919a3-572c-4071-88ef-471c2387de0c None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:00:48.722789 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed261644-8469-4371-95b8-3c6a26b6456d None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:00:48.722892 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6919a3-572c-4071-88ef-471c2387de0c None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:00:48.723076 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6919a3-572c-4071-88ef-471c2387de0c None admin] PATH_INFO: `/v3/users/56bca2bbd2d2444db9b75331d5fa6002` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:00:48.723238 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed261644-8469-4371-95b8-3c6a26b6456d None admin] PATH_INFO: `/v3/users/56bca2bbd2d2444db9b75331d5fa6002` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:00:48.724228 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6919a3-572c-4071-88ef-471c2387de0c None admin] RBAC: Authorizing `identity:get_user(user_id=56bca2bbd2d2444db9b75331d5fa6002)` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:00:48.724413 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed261644-8469-4371-95b8-3c6a26b6456d None admin] RBAC: Authorizing `identity:get_user(user_id=56bca2bbd2d2444db9b75331d5fa6002)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:00:48.725700 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6919a3-572c-4071-88ef-471c2387de0c None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:00:48.725970 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed261644-8469-4371-95b8-3c6a26b6456d None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:00:48.727611 dv-cinder-862365-1-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 92/178] 10.222.0.23 () {56 vars in 1177 bytes} [Fri Oct 28 19:00:48 2022] GET /identity/v3/users/56bca2bbd2d2444db9b75331d5fa6002 => generated 283 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:00:48.727873 dv-cinder-862365-1-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 87/179] 10.222.0.23 () {56 vars in 1177 bytes} [Fri Oct 28 19:00:48 2022] GET /identity/v3/users/56bca2bbd2d2444db9b75331d5fa6002 => generated 283 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:00:48.728358 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6919a3-572c-4071-88ef-471c2387de0c None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:00:48.733963 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed261644-8469-4371-95b8-3c6a26b6456d None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:00:48.781153 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:00:48.820455 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:00:48.850734 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6919a3-572c-4071-88ef-471c2387de0c None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:00:48.851895 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed261644-8469-4371-95b8-3c6a26b6456d None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:00:48.887878 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01846f3b-7442-4ec2-9a73-57d7dcdfab80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:00:48.888776 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01846f3b-7442-4ec2-9a73-57d7dcdfab80 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:00:48.889206 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01846f3b-7442-4ec2-9a73-57d7dcdfab80 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:00:48.889650 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01846f3b-7442-4ec2-9a73-57d7dcdfab80 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:00:48.890982 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee0c321-9dfc-4103-95e6-497e0be18f92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:00:48.891738 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee0c321-9dfc-4103-95e6-497e0be18f92 None admin] REQUEST_METHOD: `PUT` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:00:48.892114 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee0c321-9dfc-4103-95e6-497e0be18f92 None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:00:48.892541 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee0c321-9dfc-4103-95e6-497e0be18f92 None admin] PATH_INFO: `/v3/projects/0e59baa74fa1427ab5e2f47d5fb1e4c7/users/89811646982e4955a993eb2f84ca845b/roles/c193f661c7504bdf80c036f745eba59b` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:00:48.894822 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee0c321-9dfc-4103-95e6-497e0be18f92 None admin] RBAC: Authorizing `identity:create_grant(project_id=0e59baa74fa1427ab5e2f47d5fb1e4c7, user_id=89811646982e4955a993eb2f84ca845b, role_id=c193f661c7504bdf80c036f745eba59b)` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:00:48.896375 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee0c321-9dfc-4103-95e6-497e0be18f92 None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:00:48.924050 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:00:48.960503 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01846f3b-7442-4ec2-9a73-57d7dcdfab80 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:00:48.962294 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01846f3b-7442-4ec2-9a73-57d7dcdfab80 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:00:48.973635 dv-cinder-862365-1-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 93/180] 10.222.0.23 () {58 vars in 1439 bytes} [Fri Oct 28 19:00:48 2022] PUT /identity/v3/projects/0e59baa74fa1427ab5e2f47d5fb1e4c7/users/89811646982e4955a993eb2f84ca845b/roles/c193f661c7504bdf80c036f745eba59b => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 19:00:48.975320 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee0c321-9dfc-4103-95e6-497e0be18f92 None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:00:49.112268 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee0c321-9dfc-4103-95e6-497e0be18f92 None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:00:49.155553 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b339bd8b-487b-4f7b-b1f0-52481e8ff2ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:00:49.156830 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b339bd8b-487b-4f7b-b1f0-52481e8ff2ff None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:00:49.157303 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b339bd8b-487b-4f7b-b1f0-52481e8ff2ff None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:00:49.157834 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b339bd8b-487b-4f7b-b1f0-52481e8ff2ff None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:00:49.162707 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:00:49.192280 dv-cinder-862365-1-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 88/181] 10.222.0.23 () {58 vars in 1282 bytes} [Fri Oct 28 19:00:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 459 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Oct 28 19:00:49.198227 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01846f3b-7442-4ec2-9a73-57d7dcdfab80 None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:00:49.246086 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b339bd8b-487b-4f7b-b1f0-52481e8ff2ff None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:00:49.248574 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b339bd8b-487b-4f7b-b1f0-52481e8ff2ff None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:00:49.323418 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:00:49.376803 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01846f3b-7442-4ec2-9a73-57d7dcdfab80 None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:00:49.394801 dv-cinder-862365-1-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 94/182] 10.222.0.23 () {58 vars in 1282 bytes} [Fri Oct 28 19:00:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 420 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 28 19:00:49.399947 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b339bd8b-487b-4f7b-b1f0-52481e8ff2ff None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:00:49.439375 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae06c030-364f-45fc-8cbc-23c0368299fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:00:49.440296 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae06c030-364f-45fc-8cbc-23c0368299fe None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:00:49.440577 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae06c030-364f-45fc-8cbc-23c0368299fe None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:00:49.441106 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae06c030-364f-45fc-8cbc-23c0368299fe None admin] PATH_INFO: `/v3/projects/0e59baa74fa1427ab5e2f47d5fb1e4c7` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:00:49.442929 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae06c030-364f-45fc-8cbc-23c0368299fe None admin] RBAC: Authorizing `identity:get_project(project_id=0e59baa74fa1427ab5e2f47d5fb1e4c7)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:00:49.445059 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae06c030-364f-45fc-8cbc-23c0368299fe None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:00:49.447237 dv-cinder-862365-1-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 89/183] 10.222.0.23 () {56 vars in 1186 bytes} [Fri Oct 28 19:00:49 2022] GET /identity/v3/projects/0e59baa74fa1427ab5e2f47d5fb1e4c7 => generated 302 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 19:00:49.452965 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae06c030-364f-45fc-8cbc-23c0368299fe None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:00:49.454399 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:00:49.546869 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b339bd8b-487b-4f7b-b1f0-52481e8ff2ff None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:00:49.582464 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c377661-b9e9-4424-a4eb-268610f1e7c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:00:49.583098 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c377661-b9e9-4424-a4eb-268610f1e7c8 None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:00:49.583375 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c377661-b9e9-4424-a4eb-268610f1e7c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:00:49.583644 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c377661-b9e9-4424-a4eb-268610f1e7c8 None admin] PATH_INFO: `/v3/projects/0e59baa74fa1427ab5e2f47d5fb1e4c7` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:00:49.584775 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c377661-b9e9-4424-a4eb-268610f1e7c8 None admin] RBAC: Authorizing `identity:get_project(project_id=0e59baa74fa1427ab5e2f47d5fb1e4c7)` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:00:49.586826 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c377661-b9e9-4424-a4eb-268610f1e7c8 None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:00:49.588471 dv-cinder-862365-1-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 95/184] 10.222.0.23 () {56 vars in 1186 bytes} [Fri Oct 28 19:00:49 2022] GET /identity/v3/projects/0e59baa74fa1427ab5e2f47d5fb1e4c7 => generated 302 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:00:49.594078 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c377661-b9e9-4424-a4eb-268610f1e7c8 None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:00:49.620010 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae06c030-364f-45fc-8cbc-23c0368299fe None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:00:49.668714 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:00:49.673225 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd65af9-5497-4a6c-b278-b881c61c37c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:00:49.674400 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd65af9-5497-4a6c-b278-b881c61c37c3 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:00:49.674893 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd65af9-5497-4a6c-b278-b881c61c37c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:00:49.675413 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd65af9-5497-4a6c-b278-b881c61c37c3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:00:49.676341 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd65af9-5497-4a6c-b278-b881c61c37c3 None admin] RBAC: Adding query filter params (role.id=a9e4e47c2bf448fcbada91c1174644f7, scope.project.id=0e59baa74fa1427ab5e2f47d5fb1e4c7, user.id=56bca2bbd2d2444db9b75331d5fa6002) {{(pid=81766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:00:49.676855 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd65af9-5497-4a6c-b278-b881c61c37c3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:00:49.678842 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd65af9-5497-4a6c-b278-b881c61c37c3 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:00:49.694288 dv-cinder-862365-1-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 90/185] 10.222.0.23 () {56 vars in 1374 bytes} [Fri Oct 28 19:00:49 2022] GET /identity/v3/role_assignments?user.id=56bca2bbd2d2444db9b75331d5fa6002&scope.project.id=0e59baa74fa1427ab5e2f47d5fb1e4c7&role.id=a9e4e47c2bf448fcbada91c1174644f7 => generated 608 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 19:00:49.719473 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c377661-b9e9-4424-a4eb-268610f1e7c8 None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:00:49.722257 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:00:49.771639 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b630bfdc-690e-41fc-9c59-3ccfff4d8a2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:00:49.772273 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b630bfdc-690e-41fc-9c59-3ccfff4d8a2d None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:00:49.772551 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b630bfdc-690e-41fc-9c59-3ccfff4d8a2d None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:00:49.772821 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b630bfdc-690e-41fc-9c59-3ccfff4d8a2d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:00:49.773590 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b630bfdc-690e-41fc-9c59-3ccfff4d8a2d None admin] RBAC: Adding query filter params (role.id=a11a1b300fe044b5a905284bc623dc41, scope.project.id=0e59baa74fa1427ab5e2f47d5fb1e4c7, user.id=56bca2bbd2d2444db9b75331d5fa6002) {{(pid=81765) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:00:49.773905 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b630bfdc-690e-41fc-9c59-3ccfff4d8a2d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:00:49.775352 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b630bfdc-690e-41fc-9c59-3ccfff4d8a2d None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:00:49.786674 dv-cinder-862365-1-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 96/186] 10.222.0.23 () {56 vars in 1374 bytes} [Fri Oct 28 19:00:49 2022] GET /identity/v3/role_assignments?user.id=56bca2bbd2d2444db9b75331d5fa6002&scope.project.id=0e59baa74fa1427ab5e2f47d5fb1e4c7&role.id=a11a1b300fe044b5a905284bc623dc41 => generated 608 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:00:50.657175 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc41a7f-755d-4ec1-b3ef-fa5a29d98faf None None] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:00:50.657775 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc41a7f-755d-4ec1-b3ef-fa5a29d98faf None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:00:50.657775 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc41a7f-755d-4ec1-b3ef-fa5a29d98faf None None] PATH_INFO: `/` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:00:50.659164 dv-cinder-862365-1-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 91/187] 10.222.0.23 () {54 vars in 927 bytes} [Fri Oct 28 19:00:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 19:00:50.664158 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d78af7-cbae-47a4-ac8c-aff4852b39cc None None] REQUEST_METHOD: `POST` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:00:50.664558 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d78af7-cbae-47a4-ac8c-aff4852b39cc None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:00:50.664722 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d78af7-cbae-47a4-ac8c-aff4852b39cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:00:50.683690 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.auth.core [None req-b7d78af7-cbae-47a4-ac8c-aff4852b39cc None None] MFA Rules not processed for user `ae863915635746d1ac19970949de4722`. Rule list: `[]` (Enabled: `True`). {{(pid=81765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:00:50.684884 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-b7d78af7-cbae-47a4-ac8c-aff4852b39cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:00:50.721846 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56dc933-a4db-4f76-aa82-fed73644323a None None] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:00:50.722153 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56dc933-a4db-4f76-aa82-fed73644323a None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:00:50.722401 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56dc933-a4db-4f76-aa82-fed73644323a None None] PATH_INFO: `/` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:00:50.723773 dv-cinder-862365-1-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 92/188] 10.222.0.23 () {54 vars in 927 bytes} [Fri Oct 28 19:00:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 28 19:00:50.728504 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27cbf4b-42bb-4fbc-8cd1-be474fe96128 None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:00:50.728787 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27cbf4b-42bb-4fbc-8cd1-be474fe96128 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:00:50.729067 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27cbf4b-42bb-4fbc-8cd1-be474fe96128 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:00:50.747564 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-f27cbf4b-42bb-4fbc-8cd1-be474fe96128 None None] MFA Rules not processed for user `ae863915635746d1ac19970949de4722`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:00:50.748732 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-f27cbf4b-42bb-4fbc-8cd1-be474fe96128 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:00:50.754469 dv-cinder-862365-1-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 97/189] 10.222.0.23 () {58 vars in 1024 bytes} [Fri Oct 28 19:00:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 28 19:00:50.818207 dv-cinder-862365-1-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 93/190] 10.222.0.23 () {58 vars in 1024 bytes} [Fri Oct 28 19:00:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 28 19:00:51.022524 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d78af7-cbae-47a4-ac8c-aff4852b39cc None None] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:00:51.087493 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27cbf4b-42bb-4fbc-8cd1-be474fe96128 None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:00:51.122853 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:00:51.127608 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d78af7-cbae-47a4-ac8c-aff4852b39cc None None] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:00:51.164853 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280e218a-bee1-47a4-bf58-9e68a8f512f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:00:51.165522 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280e218a-bee1-47a4-bf58-9e68a8f512f5 None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:00:51.165808 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280e218a-bee1-47a4-bf58-9e68a8f512f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:00:51.166087 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280e218a-bee1-47a4-bf58-9e68a8f512f5 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:00:51.177631 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280e218a-bee1-47a4-bf58-9e68a8f512f5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 19:00:51.182524 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application [None req-280e218a-bee1-47a4-bf58-9e68a8f512f5 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 28 19:00:51.182524 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 19:00:51.182524 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 19:00:51.182524 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 19:00:51.182524 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 19:00:51.182524 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 19:00:51.182524 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 19:00:51.182524 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 19:00:51.182524 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 19:00:51.182524 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 19:00:51.182524 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 19:00:51.182524 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 19:00:51.182524 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 28 19:00:51.182524 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 28 19:00:51.182524 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 28 19:00:51.182524 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 28 19:00:51.183444 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 28 19:00:51.183444 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 28 19:00:51.183444 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 28 19:00:51.183444 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 28 19:00:51.183444 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 19:00:51.183444 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 19:00:51.183444 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 19:00:51.183444 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 19:00:51.183444 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 19:00:51.183444 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 19:00:51.183444 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 19:00:51.183444 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application with Lock( Oct 28 19:00:51.183444 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 19:00:51.183444 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._enter() Oct 28 19:00:51.183444 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 19:00:51.183444 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 19:00:51.184863 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 19:00:51.184863 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.creator() Oct 28 19:00:51.184863 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 19:00:51.184863 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application created_value = creator( Oct 28 19:00:51.184863 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 28 19:00:51.184863 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 28 19:00:51.184863 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 28 19:00:51.184863 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 28 19:00:51.184863 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 28 19:00:51.184863 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 28 19:00:51.184863 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 28 19:00:51.184863 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application Oct 28 19:00:51.184863 dv-cinder-862365-1-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 98/191] 10.222.0.23 () {56 vars in 1099 bytes} [Fri Oct 28 19:00:51 2022] GET /identity/v3/roles/reader => generated 84 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 19:00:51.189274 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280e218a-bee1-47a4-bf58-9e68a8f512f5 None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:00:51.192272 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27cbf4b-42bb-4fbc-8cd1-be474fe96128 None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:00:51.219139 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:00:51.227780 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec307608-09de-4ad0-b476-2275c41ab6a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:00:51.231190 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec307608-09de-4ad0-b476-2275c41ab6a0 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:00:51.231190 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec307608-09de-4ad0-b476-2275c41ab6a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:00:51.231190 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec307608-09de-4ad0-b476-2275c41ab6a0 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:00:51.231190 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec307608-09de-4ad0-b476-2275c41ab6a0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:00:51.232149 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec307608-09de-4ad0-b476-2275c41ab6a0 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:00:51.233947 dv-cinder-862365-1-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 94/192] 10.222.0.23 () {56 vars in 1108 bytes} [Fri Oct 28 19:00:51 2022] GET /identity/v3/domains/default => generated 199 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 19:00:51.239121 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec307608-09de-4ad0-b476-2275c41ab6a0 None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:00:51.301446 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280e218a-bee1-47a4-bf58-9e68a8f512f5 None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:00:51.340489 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8bc919f-03a1-406e-8b81-55a23753a891 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:00:51.341121 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bc919f-03a1-406e-8b81-55a23753a891 None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:00:51.341443 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bc919f-03a1-406e-8b81-55a23753a891 None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:00:51.341726 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bc919f-03a1-406e-8b81-55a23753a891 None admin] PATH_INFO: `/v3/roles` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:00:51.342415 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8bc919f-03a1-406e-8b81-55a23753a891 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81765) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:00:51.342720 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8bc919f-03a1-406e-8b81-55a23753a891 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:00:51.344127 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8bc919f-03a1-406e-8b81-55a23753a891 None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:00:51.351829 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec307608-09de-4ad0-b476-2275c41ab6a0 None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:00:51.358037 dv-cinder-862365-1-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 99/193] 10.222.0.23 () {56 vars in 1101 bytes} [Fri Oct 28 19:00:51 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 19:00:51.359103 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8bc919f-03a1-406e-8b81-55a23753a891 None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:00:51.383382 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:00:51.393773 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d413090c-a9eb-44ff-b943-e22a4c1b4b82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:00:51.395939 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d413090c-a9eb-44ff-b943-e22a4c1b4b82 None admin] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:00:51.395939 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d413090c-a9eb-44ff-b943-e22a4c1b4b82 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:00:51.395939 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d413090c-a9eb-44ff-b943-e22a4c1b4b82 None admin] PATH_INFO: `/v3/users` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:00:51.395939 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d413090c-a9eb-44ff-b943-e22a4c1b4b82 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:00:51.397415 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d413090c-a9eb-44ff-b943-e22a4c1b4b82 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:00:51.463343 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8bc919f-03a1-406e-8b81-55a23753a891 None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:00:51.471264 dv-cinder-862365-1-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 95/194] 10.222.0.23 () {60 vars in 1132 bytes} [Fri Oct 28 19:00:51 2022] POST /identity/v3/users => generated 293 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 28 19:00:51.472610 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e495c3-2080-42c8-96b3-56e0f7a9c007 None None] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:00:51.472893 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e495c3-2080-42c8-96b3-56e0f7a9c007 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:00:51.473195 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e495c3-2080-42c8-96b3-56e0f7a9c007 None None] PATH_INFO: `/` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:00:51.474418 dv-cinder-862365-1-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 96/195] 10.222.0.23 () {54 vars in 927 bytes} [Fri Oct 28 19:00:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 19:00:51.481198 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150d3fb9-4589-4812-a4fa-a1a714a12678 None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:00:51.481537 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150d3fb9-4589-4812-a4fa-a1a714a12678 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:00:51.481812 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150d3fb9-4589-4812-a4fa-a1a714a12678 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:00:51.502639 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-150d3fb9-4589-4812-a4fa-a1a714a12678 None None] MFA Rules not processed for user `ae863915635746d1ac19970949de4722`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:00:51.503874 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-150d3fb9-4589-4812-a4fa-a1a714a12678 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:00:51.511515 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9eba3b9-0fb1-4e7a-95ea-7f1177222921 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:00:51.512180 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9eba3b9-0fb1-4e7a-95ea-7f1177222921 None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:00:51.512461 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9eba3b9-0fb1-4e7a-95ea-7f1177222921 None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:00:51.512735 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9eba3b9-0fb1-4e7a-95ea-7f1177222921 None admin] PATH_INFO: `/v3/users/4322ba8905524a43b57e7277989b5daa` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:00:51.528240 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9eba3b9-0fb1-4e7a-95ea-7f1177222921 None admin] RBAC: Authorizing `identity:get_user(user_id=4322ba8905524a43b57e7277989b5daa)` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:00:51.529802 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9eba3b9-0fb1-4e7a-95ea-7f1177222921 None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:00:51.531780 dv-cinder-862365-1-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 100/196] 10.222.0.23 () {56 vars in 1177 bytes} [Fri Oct 28 19:00:51 2022] GET /identity/v3/users/4322ba8905524a43b57e7277989b5daa => generated 297 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 19:00:51.537417 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9eba3b9-0fb1-4e7a-95ea-7f1177222921 None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:00:51.558359 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:00:51.580228 dv-cinder-862365-1-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 97/197] 10.222.0.23 () {58 vars in 1024 bytes} [Fri Oct 28 19:00:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 28 19:00:51.627980 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:00:51.650976 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9eba3b9-0fb1-4e7a-95ea-7f1177222921 None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:00:51.687956 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc2fd41-e1fc-496f-a493-47875082b1d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:00:51.688588 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc2fd41-e1fc-496f-a493-47875082b1d8 None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:00:51.688858 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc2fd41-e1fc-496f-a493-47875082b1d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:00:51.689128 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc2fd41-e1fc-496f-a493-47875082b1d8 None admin] PATH_INFO: `/v3/projects/0e59baa74fa1427ab5e2f47d5fb1e4c7` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:00:51.690322 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc2fd41-e1fc-496f-a493-47875082b1d8 None admin] RBAC: Authorizing `identity:get_project(project_id=0e59baa74fa1427ab5e2f47d5fb1e4c7)` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:00:51.691763 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc2fd41-e1fc-496f-a493-47875082b1d8 None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:00:51.694435 dv-cinder-862365-1-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 101/198] 10.222.0.23 () {56 vars in 1186 bytes} [Fri Oct 28 19:00:51 2022] GET /identity/v3/projects/0e59baa74fa1427ab5e2f47d5fb1e4c7 => generated 302 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 19:00:51.699986 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150d3fb9-4589-4812-a4fa-a1a714a12678 None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:00:51.809263 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150d3fb9-4589-4812-a4fa-a1a714a12678 None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:00:51.848067 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0fa63b-225f-4864-8a5f-5b81cc6d478a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:00:51.848742 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0fa63b-225f-4864-8a5f-5b81cc6d478a None admin] REQUEST_METHOD: `PUT` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:00:51.849018 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0fa63b-225f-4864-8a5f-5b81cc6d478a None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:00:51.849290 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0fa63b-225f-4864-8a5f-5b81cc6d478a None admin] PATH_INFO: `/v3/projects/0e59baa74fa1427ab5e2f47d5fb1e4c7/users/4322ba8905524a43b57e7277989b5daa/roles/ba7a86f4918e49709c1bae8d5942bf42` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:00:51.851405 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0fa63b-225f-4864-8a5f-5b81cc6d478a None admin] RBAC: Authorizing `identity:create_grant(project_id=0e59baa74fa1427ab5e2f47d5fb1e4c7, user_id=4322ba8905524a43b57e7277989b5daa, role_id=ba7a86f4918e49709c1bae8d5942bf42)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:00:51.852972 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0fa63b-225f-4864-8a5f-5b81cc6d478a None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:00:51.859659 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc2fd41-e1fc-496f-a493-47875082b1d8 None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:00:51.907501 dv-cinder-862365-1-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 98/199] 10.222.0.23 () {58 vars in 1439 bytes} [Fri Oct 28 19:00:51 2022] PUT /identity/v3/projects/0e59baa74fa1427ab5e2f47d5fb1e4c7/users/4322ba8905524a43b57e7277989b5daa/roles/ba7a86f4918e49709c1bae8d5942bf42 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 19:00:51.981395 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc2fd41-e1fc-496f-a493-47875082b1d8 None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:00:52.025169 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96982296-bb93-4b86-8f91-261e56d3adf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:00:52.025846 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96982296-bb93-4b86-8f91-261e56d3adf2 None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:00:52.026131 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96982296-bb93-4b86-8f91-261e56d3adf2 None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:00:52.026401 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96982296-bb93-4b86-8f91-261e56d3adf2 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:00:52.038563 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96982296-bb93-4b86-8f91-261e56d3adf2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 19:00:52.044053 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application [None req-96982296-bb93-4b86-8f91-261e56d3adf2 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 28 19:00:52.044053 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 19:00:52.044053 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 19:00:52.044053 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 19:00:52.044053 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 19:00:52.044053 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 19:00:52.044053 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 19:00:52.044053 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 19:00:52.044053 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 19:00:52.044053 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 19:00:52.044053 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 19:00:52.044053 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 19:00:52.044053 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 28 19:00:52.044053 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 28 19:00:52.044053 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 28 19:00:52.044053 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 28 19:00:52.044935 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 28 19:00:52.044935 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 28 19:00:52.044935 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 28 19:00:52.044935 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 28 19:00:52.044935 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 19:00:52.044935 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 19:00:52.044935 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 19:00:52.044935 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 19:00:52.044935 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 19:00:52.044935 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 19:00:52.044935 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 19:00:52.044935 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application with Lock( Oct 28 19:00:52.044935 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 19:00:52.044935 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._enter() Oct 28 19:00:52.044935 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 19:00:52.044935 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 19:00:52.045760 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 19:00:52.045760 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.creator() Oct 28 19:00:52.045760 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 19:00:52.045760 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application created_value = creator( Oct 28 19:00:52.045760 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 28 19:00:52.045760 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 28 19:00:52.045760 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 28 19:00:52.045760 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 28 19:00:52.045760 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 28 19:00:52.045760 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 28 19:00:52.045760 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 28 19:00:52.045760 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application Oct 28 19:00:52.045760 dv-cinder-862365-1-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 102/200] 10.222.0.23 () {56 vars in 1099 bytes} [Fri Oct 28 19:00:51 2022] GET /identity/v3/roles/member => generated 84 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 19:00:52.051350 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0fa63b-225f-4864-8a5f-5b81cc6d478a None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:00:52.099536 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:00:52.161939 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0fa63b-225f-4864-8a5f-5b81cc6d478a None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:00:52.197444 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4562421-1402-41d9-a083-cea9d900b530 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:00:52.198054 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4562421-1402-41d9-a083-cea9d900b530 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:00:52.198643 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4562421-1402-41d9-a083-cea9d900b530 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:00:52.198914 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4562421-1402-41d9-a083-cea9d900b530 None admin] PATH_INFO: `/v3/roles` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:00:52.199576 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4562421-1402-41d9-a083-cea9d900b530 None admin] RBAC: Adding query filter params (name=member) {{(pid=81766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:00:52.199876 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4562421-1402-41d9-a083-cea9d900b530 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:00:52.201240 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4562421-1402-41d9-a083-cea9d900b530 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:00:52.211117 dv-cinder-862365-1-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 99/201] 10.222.0.23 () {56 vars in 1101 bytes} [Fri Oct 28 19:00:52 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:00:52.216912 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96982296-bb93-4b86-8f91-261e56d3adf2 None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:00:52.226491 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:00:52.322677 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96982296-bb93-4b86-8f91-261e56d3adf2 None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:00:52.359839 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4302fd0-47a9-46d6-8ad5-113c334d85c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:00:52.360390 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4302fd0-47a9-46d6-8ad5-113c334d85c9 None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:00:52.360709 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4302fd0-47a9-46d6-8ad5-113c334d85c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:00:52.361014 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4302fd0-47a9-46d6-8ad5-113c334d85c9 None admin] PATH_INFO: `/v3/users/89811646982e4955a993eb2f84ca845b` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:00:52.362141 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4302fd0-47a9-46d6-8ad5-113c334d85c9 None admin] RBAC: Authorizing `identity:get_user(user_id=89811646982e4955a993eb2f84ca845b)` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:00:52.363621 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4302fd0-47a9-46d6-8ad5-113c334d85c9 None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:00:52.365203 dv-cinder-862365-1-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 103/202] 10.222.0.23 () {56 vars in 1177 bytes} [Fri Oct 28 19:00:52 2022] GET /identity/v3/users/89811646982e4955a993eb2f84ca845b => generated 297 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:00:52.371107 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4562421-1402-41d9-a083-cea9d900b530 None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:00:52.474697 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4562421-1402-41d9-a083-cea9d900b530 None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:00:52.476215 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:00:52.509717 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731367b5-439b-4c64-948d-74cbc4f3cca2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:00:52.510327 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731367b5-439b-4c64-948d-74cbc4f3cca2 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:00:52.510611 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731367b5-439b-4c64-948d-74cbc4f3cca2 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:00:52.510918 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731367b5-439b-4c64-948d-74cbc4f3cca2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:00:52.584995 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731367b5-439b-4c64-948d-74cbc4f3cca2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:00:52.586819 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731367b5-439b-4c64-948d-74cbc4f3cca2 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:00:52.690864 dv-cinder-862365-1-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 100/203] 10.222.0.23 () {58 vars in 1282 bytes} [Fri Oct 28 19:00:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 28 19:00:52.696384 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4302fd0-47a9-46d6-8ad5-113c334d85c9 None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:00:52.777503 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:00:52.805560 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4302fd0-47a9-46d6-8ad5-113c334d85c9 None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:00:52.841993 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eccca2ee-aa3a-47b2-b8e6-88989dbe2794 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:00:52.842637 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccca2ee-aa3a-47b2-b8e6-88989dbe2794 None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:00:52.843012 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccca2ee-aa3a-47b2-b8e6-88989dbe2794 None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:00:52.843295 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccca2ee-aa3a-47b2-b8e6-88989dbe2794 None admin] PATH_INFO: `/v3/projects/0e59baa74fa1427ab5e2f47d5fb1e4c7` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:00:52.844699 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eccca2ee-aa3a-47b2-b8e6-88989dbe2794 None admin] RBAC: Authorizing `identity:get_project(project_id=0e59baa74fa1427ab5e2f47d5fb1e4c7)` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:00:52.846208 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eccca2ee-aa3a-47b2-b8e6-88989dbe2794 None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:00:52.847881 dv-cinder-862365-1-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 104/204] 10.222.0.23 () {56 vars in 1186 bytes} [Fri Oct 28 19:00:52 2022] GET /identity/v3/projects/0e59baa74fa1427ab5e2f47d5fb1e4c7 => generated 302 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:00:52.854017 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731367b5-439b-4c64-948d-74cbc4f3cca2 None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:00:52.856283 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:00:52.959534 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731367b5-439b-4c64-948d-74cbc4f3cca2 None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:00:52.995159 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca7ea5b-7454-46b2-8c4c-57ef6790ff85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:00:52.996385 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca7ea5b-7454-46b2-8c4c-57ef6790ff85 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:00:52.996670 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca7ea5b-7454-46b2-8c4c-57ef6790ff85 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:00:52.996946 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca7ea5b-7454-46b2-8c4c-57ef6790ff85 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:00:52.997703 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca7ea5b-7454-46b2-8c4c-57ef6790ff85 None admin] RBAC: Adding query filter params (role.id=c193f661c7504bdf80c036f745eba59b, scope.project.id=0e59baa74fa1427ab5e2f47d5fb1e4c7, user.id=89811646982e4955a993eb2f84ca845b) {{(pid=81766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:00:52.998015 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca7ea5b-7454-46b2-8c4c-57ef6790ff85 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:00:52.999448 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca7ea5b-7454-46b2-8c4c-57ef6790ff85 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:00:53.005639 dv-cinder-862365-1-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 101/205] 10.222.0.23 () {56 vars in 1374 bytes} [Fri Oct 28 19:00:52 2022] GET /identity/v3/role_assignments?user.id=89811646982e4955a993eb2f84ca845b&scope.project.id=0e59baa74fa1427ab5e2f47d5fb1e4c7&role.id=c193f661c7504bdf80c036f745eba59b => generated 608 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:00:53.892530 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb1ac72-9334-4aa6-822d-db87e0adb4b4 None None] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:00:53.893028 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb1ac72-9334-4aa6-822d-db87e0adb4b4 None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:00:53.893103 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb1ac72-9334-4aa6-822d-db87e0adb4b4 None None] PATH_INFO: `/` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:00:53.894593 dv-cinder-862365-1-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 105/206] 10.222.0.23 () {54 vars in 927 bytes} [Fri Oct 28 19:00:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 19:00:53.899672 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f21ba58-f99a-43de-9d69-6526729acf5c None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:00:53.900061 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f21ba58-f99a-43de-9d69-6526729acf5c None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:00:53.900237 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f21ba58-f99a-43de-9d69-6526729acf5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:00:53.909407 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1356ac-0c9d-4e70-b9b7-50e737e0636a None None] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:00:53.909701 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1356ac-0c9d-4e70-b9b7-50e737e0636a None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:00:53.909977 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1356ac-0c9d-4e70-b9b7-50e737e0636a None None] PATH_INFO: `/` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:00:53.911402 dv-cinder-862365-1-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 106/207] 10.222.0.23 () {54 vars in 927 bytes} [Fri Oct 28 19:00:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 28 19:00:53.916238 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d9f998-7c8a-4ac3-a4a8-a7b08082d82e None None] REQUEST_METHOD: `POST` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:00:53.916526 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d9f998-7c8a-4ac3-a4a8-a7b08082d82e None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:00:53.916804 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d9f998-7c8a-4ac3-a4a8-a7b08082d82e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:00:53.919907 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-9f21ba58-f99a-43de-9d69-6526729acf5c None None] MFA Rules not processed for user `ae863915635746d1ac19970949de4722`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:00:53.921080 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-9f21ba58-f99a-43de-9d69-6526729acf5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:00:53.935310 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.auth.core [None req-30d9f998-7c8a-4ac3-a4a8-a7b08082d82e None None] MFA Rules not processed for user `ae863915635746d1ac19970949de4722`. Rule list: `[]` (Enabled: `True`). {{(pid=81765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:00:53.936507 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-30d9f998-7c8a-4ac3-a4a8-a7b08082d82e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:00:53.990058 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:00:53.997714 dv-cinder-862365-1-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 102/208] 10.222.0.23 () {58 vars in 1024 bytes} [Fri Oct 28 19:00:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 28 19:00:54.011628 dv-cinder-862365-1-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 107/209] 10.222.0.23 () {58 vars in 1024 bytes} [Fri Oct 28 19:00:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 28 19:00:54.180681 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87eb2bd8-c9d9-49be-a8df-4fe08c123e88 None None] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:00:54.181015 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87eb2bd8-c9d9-49be-a8df-4fe08c123e88 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:00:54.181212 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87eb2bd8-c9d9-49be-a8df-4fe08c123e88 None None] PATH_INFO: `/` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:00:54.182772 dv-cinder-862365-1-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 103/210] 10.222.0.23 () {54 vars in 927 bytes} [Fri Oct 28 19:00:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 19:00:54.187779 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af7950c-a2ed-41b1-a3d6-7b1bcda0a57f None None] REQUEST_METHOD: `POST` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:00:54.188065 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af7950c-a2ed-41b1-a3d6-7b1bcda0a57f None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:00:54.188341 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af7950c-a2ed-41b1-a3d6-7b1bcda0a57f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:00:54.207604 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.auth.core [None req-2af7950c-a2ed-41b1-a3d6-7b1bcda0a57f None None] MFA Rules not processed for user `ae863915635746d1ac19970949de4722`. Rule list: `[]` (Enabled: `True`). {{(pid=81765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:00:54.208777 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-2af7950c-a2ed-41b1-a3d6-7b1bcda0a57f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:00:54.287836 dv-cinder-862365-1-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 108/211] 10.222.0.23 () {58 vars in 1024 bytes} [Fri Oct 28 19:00:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 28 19:00:54.294203 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87eb2bd8-c9d9-49be-a8df-4fe08c123e88 None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:00:54.311287 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af7950c-a2ed-41b1-a3d6-7b1bcda0a57f None None] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:00:54.313895 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:00:54.412624 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87eb2bd8-c9d9-49be-a8df-4fe08c123e88 None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:00:54.431746 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af7950c-a2ed-41b1-a3d6-7b1bcda0a57f None None] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:00:54.457126 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c35bdbe-2c21-4042-988a-7917c283a897 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:00:54.457788 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c35bdbe-2c21-4042-988a-7917c283a897 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:00:54.458066 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c35bdbe-2c21-4042-988a-7917c283a897 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:00:54.458334 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c35bdbe-2c21-4042-988a-7917c283a897 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:00:54.470198 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c35bdbe-2c21-4042-988a-7917c283a897 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 19:00:54.472313 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d906889-c277-40e4-80da-c68e3608c1f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:00:54.472954 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d906889-c277-40e4-80da-c68e3608c1f4 None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:00:54.473238 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d906889-c277-40e4-80da-c68e3608c1f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:00:54.473561 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d906889-c277-40e4-80da-c68e3608c1f4 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:00:54.474704 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d906889-c277-40e4-80da-c68e3608c1f4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:00:54.475750 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application [None req-3c35bdbe-2c21-4042-988a-7917c283a897 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 28 19:00:54.475750 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 19:00:54.475750 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 19:00:54.475750 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 19:00:54.475750 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 19:00:54.475750 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 19:00:54.475750 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 19:00:54.475750 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 19:00:54.475750 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 19:00:54.475750 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 19:00:54.475750 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 19:00:54.475750 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 19:00:54.475750 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 28 19:00:54.475750 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 28 19:00:54.475750 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 28 19:00:54.475750 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 28 19:00:54.476639 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 28 19:00:54.476639 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 28 19:00:54.476639 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 28 19:00:54.476639 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 28 19:00:54.476639 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 19:00:54.476639 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 19:00:54.476639 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 19:00:54.476639 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 19:00:54.476639 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 19:00:54.476639 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 19:00:54.476639 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 19:00:54.476639 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application with Lock( Oct 28 19:00:54.476639 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 19:00:54.476639 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._enter() Oct 28 19:00:54.476639 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 19:00:54.476639 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 19:00:54.477459 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 19:00:54.477459 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.creator() Oct 28 19:00:54.477459 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 19:00:54.477459 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application created_value = creator( Oct 28 19:00:54.477459 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 28 19:00:54.477459 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 28 19:00:54.477459 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 28 19:00:54.477459 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 28 19:00:54.477459 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 28 19:00:54.477459 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 28 19:00:54.477459 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 28 19:00:54.477459 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Oct 28 19:00:54.483949 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d906889-c277-40e4-80da-c68e3608c1f4 None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:00:54.483949 dv-cinder-862365-1-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 109/212] 10.222.0.23 () {56 vars in 1108 bytes} [Fri Oct 28 19:00:54 2022] GET /identity/v3/domains/default => generated 199 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 19:00:54.484095 dv-cinder-862365-1-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 104/213] 10.222.0.23 () {56 vars in 1099 bytes} [Fri Oct 28 19:00:54 2022] GET /identity/v3/roles/member => generated 84 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 28 19:00:54.484164 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d906889-c277-40e4-80da-c68e3608c1f4 None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:00:54.487936 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c35bdbe-2c21-4042-988a-7917c283a897 None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:00:54.549421 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:00:54.568687 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:00:54.597128 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c35bdbe-2c21-4042-988a-7917c283a897 None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:00:54.602120 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d906889-c277-40e4-80da-c68e3608c1f4 None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:00:54.631989 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c40d01-81b7-4ca5-8f43-cb0daafef1b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:00:54.632587 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c40d01-81b7-4ca5-8f43-cb0daafef1b7 None admin] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:00:54.632864 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c40d01-81b7-4ca5-8f43-cb0daafef1b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:00:54.633132 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c40d01-81b7-4ca5-8f43-cb0daafef1b7 None admin] PATH_INFO: `/v3/users` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:00:54.633804 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c40d01-81b7-4ca5-8f43-cb0daafef1b7 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:00:54.635235 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c40d01-81b7-4ca5-8f43-cb0daafef1b7 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:00:54.638305 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ee0f4e-6f15-4c98-8c14-c091d22e21b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:00:54.638913 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ee0f4e-6f15-4c98-8c14-c091d22e21b3 None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:00:54.639196 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ee0f4e-6f15-4c98-8c14-c091d22e21b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:00:54.639658 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ee0f4e-6f15-4c98-8c14-c091d22e21b3 None admin] PATH_INFO: `/v3/roles` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:00:54.640782 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ee0f4e-6f15-4c98-8c14-c091d22e21b3 None admin] RBAC: Adding query filter params (name=member) {{(pid=81765) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:00:54.641236 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ee0f4e-6f15-4c98-8c14-c091d22e21b3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:00:54.642637 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ee0f4e-6f15-4c98-8c14-c091d22e21b3 None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:00:54.651489 dv-cinder-862365-1-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 110/214] 10.222.0.23 () {56 vars in 1101 bytes} [Fri Oct 28 19:00:54 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:00:54.652297 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ee0f4e-6f15-4c98-8c14-c091d22e21b3 None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:00:54.733258 dv-cinder-862365-1-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 105/215] 10.222.0.23 () {60 vars in 1132 bytes} [Fri Oct 28 19:00:54 2022] POST /identity/v3/users => generated 293 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 28 19:00:54.734122 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c40d01-81b7-4ca5-8f43-cb0daafef1b7 None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:00:54.763857 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ee0f4e-6f15-4c98-8c14-c091d22e21b3 None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:00:54.806756 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:00:54.812971 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38540e74-82f5-4da9-8190-0e449e121aa2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:00:54.814183 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38540e74-82f5-4da9-8190-0e449e121aa2 None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:00:54.815145 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38540e74-82f5-4da9-8190-0e449e121aa2 None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:00:54.815935 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38540e74-82f5-4da9-8190-0e449e121aa2 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:00:54.833377 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38540e74-82f5-4da9-8190-0e449e121aa2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 19:00:54.841545 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application [None req-38540e74-82f5-4da9-8190-0e449e121aa2 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 28 19:00:54.841545 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 19:00:54.841545 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 19:00:54.841545 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 19:00:54.841545 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 19:00:54.841545 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 19:00:54.841545 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 19:00:54.841545 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 19:00:54.841545 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 19:00:54.841545 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 19:00:54.841545 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 19:00:54.841545 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 19:00:54.841545 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 28 19:00:54.841545 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 28 19:00:54.841545 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 28 19:00:54.841545 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 28 19:00:54.842562 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 28 19:00:54.842562 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 28 19:00:54.842562 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 28 19:00:54.842562 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 28 19:00:54.842562 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 19:00:54.842562 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 19:00:54.842562 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 19:00:54.842562 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 19:00:54.842562 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 19:00:54.842562 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 19:00:54.842562 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 19:00:54.842562 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application with Lock( Oct 28 19:00:54.842562 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 19:00:54.842562 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._enter() Oct 28 19:00:54.842562 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 19:00:54.842562 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 19:00:54.843401 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 19:00:54.843401 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.creator() Oct 28 19:00:54.843401 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 19:00:54.843401 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application created_value = creator( Oct 28 19:00:54.843401 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 28 19:00:54.843401 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 28 19:00:54.843401 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 28 19:00:54.843401 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 28 19:00:54.843401 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 28 19:00:54.843401 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 28 19:00:54.843401 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 28 19:00:54.843401 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application Oct 28 19:00:54.843995 dv-cinder-862365-1-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 111/216] 10.222.0.23 () {56 vars in 1099 bytes} [Fri Oct 28 19:00:54 2022] GET /identity/v3/roles/reader => generated 84 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 19:00:54.850407 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38540e74-82f5-4da9-8190-0e449e121aa2 None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:00:54.873135 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c40d01-81b7-4ca5-8f43-cb0daafef1b7 None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:00:54.889317 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:00:54.914136 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ee8400-ef65-4390-bfc4-c820764a7010 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:00:54.914812 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ee8400-ef65-4390-bfc4-c820764a7010 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:00:54.915058 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ee8400-ef65-4390-bfc4-c820764a7010 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:00:54.915338 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ee8400-ef65-4390-bfc4-c820764a7010 None admin] PATH_INFO: `/v3/users/a0a243512b104f64b276487fbbfb8d15` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:00:54.941788 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ee8400-ef65-4390-bfc4-c820764a7010 None admin] RBAC: Authorizing `identity:get_user(user_id=a0a243512b104f64b276487fbbfb8d15)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:00:54.943983 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ee8400-ef65-4390-bfc4-c820764a7010 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:00:54.947556 dv-cinder-862365-1-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 106/217] 10.222.0.23 () {56 vars in 1177 bytes} [Fri Oct 28 19:00:54 2022] GET /identity/v3/users/a0a243512b104f64b276487fbbfb8d15 => generated 293 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:00:54.953751 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ee8400-ef65-4390-bfc4-c820764a7010 None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:00:54.971494 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38540e74-82f5-4da9-8190-0e449e121aa2 None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:00:55.012157 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ae88ee-8d5a-49a0-bd83-a4fddd684a48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:00:55.012802 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ae88ee-8d5a-49a0-bd83-a4fddd684a48 None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:00:55.013083 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ae88ee-8d5a-49a0-bd83-a4fddd684a48 None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:00:55.013375 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ae88ee-8d5a-49a0-bd83-a4fddd684a48 None admin] PATH_INFO: `/v3/roles` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:00:55.014077 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ae88ee-8d5a-49a0-bd83-a4fddd684a48 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81765) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:00:55.014383 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ae88ee-8d5a-49a0-bd83-a4fddd684a48 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:00:55.015792 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ae88ee-8d5a-49a0-bd83-a4fddd684a48 None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:00:55.026193 dv-cinder-862365-1-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 112/218] 10.222.0.23 () {56 vars in 1101 bytes} [Fri Oct 28 19:00:54 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:00:55.033611 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ae88ee-8d5a-49a0-bd83-a4fddd684a48 None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:00:55.089680 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ee8400-ef65-4390-bfc4-c820764a7010 None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:00:55.103748 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:00:55.131983 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e20d1b-68b6-48d0-a360-1a7ec0f55944 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:00:55.132522 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e20d1b-68b6-48d0-a360-1a7ec0f55944 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:00:55.132802 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e20d1b-68b6-48d0-a360-1a7ec0f55944 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:00:55.133073 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e20d1b-68b6-48d0-a360-1a7ec0f55944 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:00:55.133835 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e20d1b-68b6-48d0-a360-1a7ec0f55944 None admin] RBAC: Adding query filter params (role.id=c193f661c7504bdf80c036f745eba59b, user.id=a0a243512b104f64b276487fbbfb8d15, scope.system=all) {{(pid=81766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:00:55.134141 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e20d1b-68b6-48d0-a360-1a7ec0f55944 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:00:55.135575 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e20d1b-68b6-48d0-a360-1a7ec0f55944 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:00:55.145730 dv-cinder-862365-1-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 107/219] 10.222.0.23 () {56 vars in 1308 bytes} [Fri Oct 28 19:00:54 2022] GET /identity/v3/role_assignments?user.id=a0a243512b104f64b276487fbbfb8d15&scope.system=all&role.id=c193f661c7504bdf80c036f745eba59b => generated 226 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 19:00:55.160398 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ae88ee-8d5a-49a0-bd83-a4fddd684a48 None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:00:55.204239 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4faccda-2c3a-449b-a387-d979ca49c2d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:00:55.204947 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4faccda-2c3a-449b-a387-d979ca49c2d2 None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:00:55.205235 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4faccda-2c3a-449b-a387-d979ca49c2d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:00:55.205557 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4faccda-2c3a-449b-a387-d979ca49c2d2 None admin] PATH_INFO: `/v3/users/4322ba8905524a43b57e7277989b5daa` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:00:55.206849 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4faccda-2c3a-449b-a387-d979ca49c2d2 None admin] RBAC: Authorizing `identity:get_user(user_id=4322ba8905524a43b57e7277989b5daa)` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:00:55.208623 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4faccda-2c3a-449b-a387-d979ca49c2d2 None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:00:55.211050 dv-cinder-862365-1-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 113/220] 10.222.0.23 () {56 vars in 1177 bytes} [Fri Oct 28 19:00:55 2022] GET /identity/v3/users/4322ba8905524a43b57e7277989b5daa => generated 297 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:00:55.216365 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e20d1b-68b6-48d0-a360-1a7ec0f55944 None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:00:55.258819 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:00:55.343151 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e20d1b-68b6-48d0-a360-1a7ec0f55944 None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:00:55.390647 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb425fe0-b983-49a8-bb5f-e299278dc6b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:00:55.391697 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb425fe0-b983-49a8-bb5f-e299278dc6b4 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:00:55.392180 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb425fe0-b983-49a8-bb5f-e299278dc6b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:00:55.392651 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb425fe0-b983-49a8-bb5f-e299278dc6b4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:00:55.467963 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb425fe0-b983-49a8-bb5f-e299278dc6b4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:00:55.469463 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb425fe0-b983-49a8-bb5f-e299278dc6b4 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:00:55.505813 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:00:55.574282 dv-cinder-862365-1-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 108/221] 10.222.0.23 () {58 vars in 1282 bytes} [Fri Oct 28 19:00:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 28 19:00:55.580018 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4faccda-2c3a-449b-a387-d979ca49c2d2 None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:00:55.686158 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4faccda-2c3a-449b-a387-d979ca49c2d2 None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:00:55.709815 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:00:55.721387 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b3c789-0492-487a-88c4-a848730157b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:00:55.722026 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b3c789-0492-487a-88c4-a848730157b4 None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:00:55.722307 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b3c789-0492-487a-88c4-a848730157b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:00:55.722583 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b3c789-0492-487a-88c4-a848730157b4 None admin] PATH_INFO: `/v3/projects/0e59baa74fa1427ab5e2f47d5fb1e4c7` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:00:55.723710 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b3c789-0492-487a-88c4-a848730157b4 None admin] RBAC: Authorizing `identity:get_project(project_id=0e59baa74fa1427ab5e2f47d5fb1e4c7)` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:00:55.725265 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b3c789-0492-487a-88c4-a848730157b4 None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:00:55.726933 dv-cinder-862365-1-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 114/222] 10.222.0.23 () {56 vars in 1186 bytes} [Fri Oct 28 19:00:55 2022] GET /identity/v3/projects/0e59baa74fa1427ab5e2f47d5fb1e4c7 => generated 302 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:00:55.734419 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb425fe0-b983-49a8-bb5f-e299278dc6b4 None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:00:55.890816 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb425fe0-b983-49a8-bb5f-e299278dc6b4 None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:00:55.926750 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339ce48b-60ff-4f25-95a0-2c5358b361d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:00:55.927384 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339ce48b-60ff-4f25-95a0-2c5358b361d2 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:00:55.927640 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339ce48b-60ff-4f25-95a0-2c5358b361d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:00:55.927915 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339ce48b-60ff-4f25-95a0-2c5358b361d2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:00:55.928658 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339ce48b-60ff-4f25-95a0-2c5358b361d2 None admin] RBAC: Adding query filter params (role.id=ba7a86f4918e49709c1bae8d5942bf42, scope.project.id=0e59baa74fa1427ab5e2f47d5fb1e4c7, user.id=4322ba8905524a43b57e7277989b5daa) {{(pid=81766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:00:55.928969 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339ce48b-60ff-4f25-95a0-2c5358b361d2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:00:55.930515 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339ce48b-60ff-4f25-95a0-2c5358b361d2 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:00:55.933570 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:00:55.945883 dv-cinder-862365-1-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 109/223] 10.222.0.23 () {56 vars in 1374 bytes} [Fri Oct 28 19:00:55 2022] GET /identity/v3/role_assignments?user.id=4322ba8905524a43b57e7277989b5daa&scope.project.id=0e59baa74fa1427ab5e2f47d5fb1e4c7&role.id=ba7a86f4918e49709c1bae8d5942bf42 => generated 608 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:00:57.111339 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798ccf7f-a129-498d-9a21-a673ade57c5f None None] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:00:57.111855 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798ccf7f-a129-498d-9a21-a673ade57c5f None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:00:57.111855 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798ccf7f-a129-498d-9a21-a673ade57c5f None None] PATH_INFO: `/` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:00:57.113312 dv-cinder-862365-1-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 115/224] 10.222.0.23 () {54 vars in 927 bytes} [Fri Oct 28 19:00:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 19:00:57.119015 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649f067a-0a86-4f1a-804f-379a8ea980e3 None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:00:57.119463 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649f067a-0a86-4f1a-804f-379a8ea980e3 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:00:57.119636 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649f067a-0a86-4f1a-804f-379a8ea980e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:00:57.137926 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-649f067a-0a86-4f1a-804f-379a8ea980e3 None None] MFA Rules not processed for user `ae863915635746d1ac19970949de4722`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:00:57.139129 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-649f067a-0a86-4f1a-804f-379a8ea980e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:00:57.204632 dv-cinder-862365-1-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 110/225] 10.222.0.23 () {58 vars in 1024 bytes} [Fri Oct 28 19:00:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 28 19:00:57.209735 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d446c15f-a197-4a72-bba3-49ef942e3fd6 None None] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:00:57.210113 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d446c15f-a197-4a72-bba3-49ef942e3fd6 None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:00:57.210332 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d446c15f-a197-4a72-bba3-49ef942e3fd6 None None] PATH_INFO: `/` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:00:57.212137 dv-cinder-862365-1-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 116/226] 10.222.0.23 () {54 vars in 927 bytes} [Fri Oct 28 19:00:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 19:00:57.217855 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7176c70-0eb4-41ec-bdca-9b0a6788658e None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:00:57.218178 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7176c70-0eb4-41ec-bdca-9b0a6788658e None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:00:57.218426 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7176c70-0eb4-41ec-bdca-9b0a6788658e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:00:57.238809 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-a7176c70-0eb4-41ec-bdca-9b0a6788658e None None] MFA Rules not processed for user `ae863915635746d1ac19970949de4722`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:00:57.240016 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-a7176c70-0eb4-41ec-bdca-9b0a6788658e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:00:57.309984 dv-cinder-862365-1-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 111/227] 10.222.0.23 () {58 vars in 1024 bytes} [Fri Oct 28 19:00:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 28 19:00:57.334216 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c75a54-c990-4f2c-b7ef-182f59d6c6f2 None None] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:00:57.334498 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c75a54-c990-4f2c-b7ef-182f59d6c6f2 None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:00:57.334773 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c75a54-c990-4f2c-b7ef-182f59d6c6f2 None None] PATH_INFO: `/` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:00:57.336480 dv-cinder-862365-1-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 117/228] 10.222.0.23 () {54 vars in 927 bytes} [Fri Oct 28 19:00:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 19:00:57.341290 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8fb6a2-7400-462e-a930-5957b9080bbf None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:00:57.341608 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8fb6a2-7400-462e-a930-5957b9080bbf None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:00:57.341884 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8fb6a2-7400-462e-a930-5957b9080bbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:00:57.360377 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-ea8fb6a2-7400-462e-a930-5957b9080bbf None None] MFA Rules not processed for user `ae863915635746d1ac19970949de4722`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:00:57.361661 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-ea8fb6a2-7400-462e-a930-5957b9080bbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:00:57.416114 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:00:57.430200 dv-cinder-862365-1-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 112/229] 10.222.0.23 () {58 vars in 1024 bytes} [Fri Oct 28 19:00:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 28 19:00:57.480461 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c75a54-c990-4f2c-b7ef-182f59d6c6f2 None None] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:00:57.579140 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8fb6a2-7400-462e-a930-5957b9080bbf None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:00:57.582091 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c75a54-c990-4f2c-b7ef-182f59d6c6f2 None None] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:00:57.616517 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae250aa-3a7c-4353-a053-529227a56403 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:00:57.617070 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae250aa-3a7c-4353-a053-529227a56403 None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:00:57.617366 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae250aa-3a7c-4353-a053-529227a56403 None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:00:57.617640 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae250aa-3a7c-4353-a053-529227a56403 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:00:57.627863 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae250aa-3a7c-4353-a053-529227a56403 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 19:00:57.633093 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application [None req-fae250aa-3a7c-4353-a053-529227a56403 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 28 19:00:57.633093 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 19:00:57.633093 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 19:00:57.633093 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 19:00:57.633093 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 19:00:57.633093 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 19:00:57.633093 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 19:00:57.633093 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 19:00:57.633093 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 19:00:57.633093 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 19:00:57.633093 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 19:00:57.633093 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 19:00:57.633093 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 28 19:00:57.633093 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 28 19:00:57.633093 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 28 19:00:57.633093 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 28 19:00:57.634013 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 28 19:00:57.634013 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 28 19:00:57.634013 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 28 19:00:57.634013 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 28 19:00:57.634013 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 19:00:57.634013 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 19:00:57.634013 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 19:00:57.634013 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 19:00:57.634013 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 19:00:57.634013 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 19:00:57.634013 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 19:00:57.634013 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application with Lock( Oct 28 19:00:57.634013 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 19:00:57.634013 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._enter() Oct 28 19:00:57.634013 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 19:00:57.634013 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 19:00:57.634805 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 19:00:57.634805 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.creator() Oct 28 19:00:57.634805 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 19:00:57.634805 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application created_value = creator( Oct 28 19:00:57.634805 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 28 19:00:57.634805 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 28 19:00:57.634805 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 28 19:00:57.634805 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 28 19:00:57.634805 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 28 19:00:57.634805 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 28 19:00:57.634805 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 28 19:00:57.634805 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application Oct 28 19:00:57.634805 dv-cinder-862365-1-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 118/230] 10.222.0.23 () {56 vars in 1099 bytes} [Fri Oct 28 19:00:57 2022] GET /identity/v3/roles/reader => generated 84 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 19:00:57.639936 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae250aa-3a7c-4353-a053-529227a56403 None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:00:57.681974 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8fb6a2-7400-462e-a930-5957b9080bbf None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:00:57.691681 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:00:57.715690 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4db2677-f190-4908-b1df-fba3fb4127c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:00:57.716323 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4db2677-f190-4908-b1df-fba3fb4127c7 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:00:57.716606 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4db2677-f190-4908-b1df-fba3fb4127c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:00:57.716882 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4db2677-f190-4908-b1df-fba3fb4127c7 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:00:57.718007 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4db2677-f190-4908-b1df-fba3fb4127c7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:00:57.719454 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4db2677-f190-4908-b1df-fba3fb4127c7 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:00:57.721134 dv-cinder-862365-1-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 113/231] 10.222.0.23 () {56 vars in 1108 bytes} [Fri Oct 28 19:00:57 2022] GET /identity/v3/domains/default => generated 199 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 19:00:57.721898 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4db2677-f190-4908-b1df-fba3fb4127c7 None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:00:57.745692 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae250aa-3a7c-4353-a053-529227a56403 None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:00:57.778377 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:00:57.779304 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d335766-8003-4738-bc24-b42d9145d16a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:00:57.780249 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d335766-8003-4738-bc24-b42d9145d16a None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:00:57.786585 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d335766-8003-4738-bc24-b42d9145d16a None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:00:57.786585 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d335766-8003-4738-bc24-b42d9145d16a None admin] PATH_INFO: `/v3/roles` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:00:57.786585 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d335766-8003-4738-bc24-b42d9145d16a None admin] RBAC: Adding query filter params (name=reader) {{(pid=81765) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:00:57.786585 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d335766-8003-4738-bc24-b42d9145d16a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:00:57.786585 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d335766-8003-4738-bc24-b42d9145d16a None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:00:57.790943 dv-cinder-862365-1-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 119/232] 10.222.0.23 () {56 vars in 1101 bytes} [Fri Oct 28 19:00:57 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 19:00:57.791705 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d335766-8003-4738-bc24-b42d9145d16a None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:00:57.822163 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4db2677-f190-4908-b1df-fba3fb4127c7 None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:00:57.858715 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54e00a9-0f48-436d-9612-eea235238738 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:00:57.859351 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54e00a9-0f48-436d-9612-eea235238738 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:00:57.859628 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54e00a9-0f48-436d-9612-eea235238738 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:00:57.859902 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54e00a9-0f48-436d-9612-eea235238738 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:00:57.870028 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54e00a9-0f48-436d-9612-eea235238738 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 19:00:57.874884 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application [None req-c54e00a9-0f48-436d-9612-eea235238738 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 28 19:00:57.874884 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 19:00:57.874884 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 19:00:57.874884 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 19:00:57.874884 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 19:00:57.874884 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 19:00:57.874884 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 19:00:57.874884 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 19:00:57.874884 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 19:00:57.874884 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 19:00:57.874884 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 19:00:57.874884 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 19:00:57.874884 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 28 19:00:57.874884 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 28 19:00:57.874884 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 28 19:00:57.874884 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 28 19:00:57.875786 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 28 19:00:57.875786 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 28 19:00:57.875786 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 28 19:00:57.875786 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 28 19:00:57.875786 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 19:00:57.875786 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 19:00:57.875786 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 19:00:57.875786 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 19:00:57.875786 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 19:00:57.875786 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 19:00:57.875786 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 19:00:57.875786 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application with Lock( Oct 28 19:00:57.875786 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 19:00:57.875786 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._enter() Oct 28 19:00:57.875786 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 19:00:57.875786 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 19:00:57.876588 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 19:00:57.876588 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.creator() Oct 28 19:00:57.876588 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 19:00:57.876588 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application created_value = creator( Oct 28 19:00:57.876588 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 28 19:00:57.876588 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 28 19:00:57.876588 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 28 19:00:57.876588 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 28 19:00:57.876588 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 28 19:00:57.876588 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 28 19:00:57.876588 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 28 19:00:57.876588 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Oct 28 19:00:57.876588 dv-cinder-862365-1-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 114/233] 10.222.0.23 () {56 vars in 1099 bytes} [Fri Oct 28 19:00:57 2022] GET /identity/v3/roles/member => generated 84 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 19:00:57.877255 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54e00a9-0f48-436d-9612-eea235238738 None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:00:57.895651 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d335766-8003-4738-bc24-b42d9145d16a None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:00:57.909153 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:00:57.929042 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8690bd3-f717-456e-a7fc-4d0d3571040e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:00:57.929846 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8690bd3-f717-456e-a7fc-4d0d3571040e None admin] REQUEST_METHOD: `POST` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:00:57.930009 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8690bd3-f717-456e-a7fc-4d0d3571040e None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:00:57.930256 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8690bd3-f717-456e-a7fc-4d0d3571040e None admin] PATH_INFO: `/v3/groups` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:00:57.930880 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8690bd3-f717-456e-a7fc-4d0d3571040e None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:00:57.932322 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8690bd3-f717-456e-a7fc-4d0d3571040e None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:00:57.974467 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54e00a9-0f48-436d-9612-eea235238738 None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:00:57.989942 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:00:58.006554 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297c8466-e6a9-4cfa-8139-1b917fa28946 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:00:58.007221 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297c8466-e6a9-4cfa-8139-1b917fa28946 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:00:58.007498 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297c8466-e6a9-4cfa-8139-1b917fa28946 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:00:58.007768 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297c8466-e6a9-4cfa-8139-1b917fa28946 None admin] PATH_INFO: `/v3/users/fafe56e86c2d49b7977ac2f1c3fadc3c` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:00:58.020977 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297c8466-e6a9-4cfa-8139-1b917fa28946 None admin] RBAC: Authorizing `identity:get_user(user_id=fafe56e86c2d49b7977ac2f1c3fadc3c)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:00:58.022474 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297c8466-e6a9-4cfa-8139-1b917fa28946 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:00:58.024182 dv-cinder-862365-1-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 115/234] 10.222.0.23 () {56 vars in 1177 bytes} [Fri Oct 28 19:00:57 2022] GET /identity/v3/users/fafe56e86c2d49b7977ac2f1c3fadc3c => generated 293 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:00:58.025014 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297c8466-e6a9-4cfa-8139-1b917fa28946 None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:00:58.048023 dv-cinder-862365-1-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 120/235] 10.222.0.23 () {60 vars in 1134 bytes} [Fri Oct 28 19:00:57 2022] POST /identity/v3/groups => generated 229 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 19:00:58.049034 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8690bd3-f717-456e-a7fc-4d0d3571040e None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:00:58.132498 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297c8466-e6a9-4cfa-8139-1b917fa28946 None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:00:58.167531 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8690bd3-f717-456e-a7fc-4d0d3571040e None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:00:58.169720 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f1249f-2e86-4a4a-8153-c9a698cb59b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:00:58.170357 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f1249f-2e86-4a4a-8153-c9a698cb59b6 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:00:58.170637 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f1249f-2e86-4a4a-8153-c9a698cb59b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:00:58.170915 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f1249f-2e86-4a4a-8153-c9a698cb59b6 None admin] PATH_INFO: `/v3/roles` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:00:58.171601 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f1249f-2e86-4a4a-8153-c9a698cb59b6 None admin] RBAC: Adding query filter params (name=member) {{(pid=81766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:00:58.171909 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f1249f-2e86-4a4a-8153-c9a698cb59b6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:00:58.173331 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f1249f-2e86-4a4a-8153-c9a698cb59b6 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:00:58.182424 dv-cinder-862365-1-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 116/236] 10.222.0.23 () {56 vars in 1101 bytes} [Fri Oct 28 19:00:58 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:00:58.189000 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f1249f-2e86-4a4a-8153-c9a698cb59b6 None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:00:58.212458 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d018c2-0edb-4740-bcee-ba71f30d7504 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:00:58.213077 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d018c2-0edb-4740-bcee-ba71f30d7504 None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:00:58.213378 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d018c2-0edb-4740-bcee-ba71f30d7504 None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:00:58.213663 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d018c2-0edb-4740-bcee-ba71f30d7504 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:00:58.214432 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d018c2-0edb-4740-bcee-ba71f30d7504 None admin] RBAC: Adding query filter params (role.id=ba7a86f4918e49709c1bae8d5942bf42, user.id=fafe56e86c2d49b7977ac2f1c3fadc3c, scope.system=all) {{(pid=81765) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:00:58.214761 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d018c2-0edb-4740-bcee-ba71f30d7504 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:00:58.216875 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d018c2-0edb-4740-bcee-ba71f30d7504 None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:00:58.222322 dv-cinder-862365-1-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 121/237] 10.222.0.23 () {56 vars in 1308 bytes} [Fri Oct 28 19:00:58 2022] GET /identity/v3/role_assignments?user.id=fafe56e86c2d49b7977ac2f1c3fadc3c&scope.system=all&role.id=ba7a86f4918e49709c1bae8d5942bf42 => generated 226 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:00:58.227830 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:00:58.309567 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f1249f-2e86-4a4a-8153-c9a698cb59b6 None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:00:58.346579 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba4b1d9-b6e5-46cb-a7b0-343b9a781964 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:00:58.347226 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba4b1d9-b6e5-46cb-a7b0-343b9a781964 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:00:58.347501 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba4b1d9-b6e5-46cb-a7b0-343b9a781964 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:00:58.347774 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba4b1d9-b6e5-46cb-a7b0-343b9a781964 None admin] PATH_INFO: `/v3/users/a0a243512b104f64b276487fbbfb8d15` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:00:58.348938 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba4b1d9-b6e5-46cb-a7b0-343b9a781964 None admin] RBAC: Authorizing `identity:get_user(user_id=a0a243512b104f64b276487fbbfb8d15)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:00:58.350450 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba4b1d9-b6e5-46cb-a7b0-343b9a781964 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:00:58.352130 dv-cinder-862365-1-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 117/238] 10.222.0.23 () {56 vars in 1177 bytes} [Fri Oct 28 19:00:58 2022] GET /identity/v3/users/a0a243512b104f64b276487fbbfb8d15 => generated 293 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 19:00:58.358467 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d018c2-0edb-4740-bcee-ba71f30d7504 None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:00:58.395954 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:00:58.465471 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d018c2-0edb-4740-bcee-ba71f30d7504 None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:00:58.499487 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479af0e8-e3ef-49d3-b76b-259ddefdd454 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:00:58.500199 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479af0e8-e3ef-49d3-b76b-259ddefdd454 None admin] REQUEST_METHOD: `PUT` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:00:58.500490 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479af0e8-e3ef-49d3-b76b-259ddefdd454 None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:00:58.500764 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479af0e8-e3ef-49d3-b76b-259ddefdd454 None admin] PATH_INFO: `/v3/system/users/a0a243512b104f64b276487fbbfb8d15/roles/c193f661c7504bdf80c036f745eba59b` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:00:58.502219 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-479af0e8-e3ef-49d3-b76b-259ddefdd454 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=a0a243512b104f64b276487fbbfb8d15, role_id=c193f661c7504bdf80c036f745eba59b)` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:00:58.503606 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-479af0e8-e3ef-49d3-b76b-259ddefdd454 None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:00:58.592325 dv-cinder-862365-1-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 122/239] 10.222.0.23 () {58 vars in 1334 bytes} [Fri Oct 28 19:00:58 2022] PUT /identity/v3/system/users/a0a243512b104f64b276487fbbfb8d15/roles/c193f661c7504bdf80c036f745eba59b => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 19:01:00.268590 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e8db14-4b9f-4981-b662-2e0f524f8336 None None] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:01:00.269128 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e8db14-4b9f-4981-b662-2e0f524f8336 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:01:00.269128 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e8db14-4b9f-4981-b662-2e0f524f8336 None None] PATH_INFO: `/` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:01:00.273402 dv-cinder-862365-1-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 118/240] 10.222.0.23 () {54 vars in 927 bytes} [Fri Oct 28 19:01:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 19:01:00.276352 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a15e50b-746d-43c4-b711-04234c02035c None None] REQUEST_METHOD: `POST` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:01:00.276823 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a15e50b-746d-43c4-b711-04234c02035c None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:01:00.276900 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a15e50b-746d-43c4-b711-04234c02035c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:01:00.296588 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.auth.core [None req-5a15e50b-746d-43c4-b711-04234c02035c None None] MFA Rules not processed for user `ae863915635746d1ac19970949de4722`. Rule list: `[]` (Enabled: `True`). {{(pid=81765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:01:00.298432 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-5a15e50b-746d-43c4-b711-04234c02035c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:01:00.373402 dv-cinder-862365-1-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 123/241] 10.222.0.23 () {58 vars in 1024 bytes} [Fri Oct 28 19:01:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 28 19:01:00.373590 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dec073a-785c-4f65-a25c-5f4ad1d80546 None None] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:01:00.373590 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dec073a-785c-4f65-a25c-5f4ad1d80546 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:01:00.373590 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dec073a-785c-4f65-a25c-5f4ad1d80546 None None] PATH_INFO: `/` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:01:00.374133 dv-cinder-862365-1-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 119/242] 10.222.0.23 () {54 vars in 927 bytes} [Fri Oct 28 19:01:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 19:01:00.378942 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97db5576-32e9-447a-b596-8696379bd7fd None None] REQUEST_METHOD: `POST` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:01:00.379241 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97db5576-32e9-447a-b596-8696379bd7fd None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:01:00.379499 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97db5576-32e9-447a-b596-8696379bd7fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:01:00.397742 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.auth.core [None req-97db5576-32e9-447a-b596-8696379bd7fd None None] MFA Rules not processed for user `ae863915635746d1ac19970949de4722`. Rule list: `[]` (Enabled: `True`). {{(pid=81765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:01:00.398910 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-97db5576-32e9-447a-b596-8696379bd7fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:01:00.424088 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:01:00.466785 dv-cinder-862365-1-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 124/243] 10.222.0.23 () {58 vars in 1024 bytes} [Fri Oct 28 19:01:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 28 19:01:00.641217 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dec073a-785c-4f65-a25c-5f4ad1d80546 None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:01:00.731031 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb4c168-4a64-407f-bbb4-875a48ee375a None None] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:01:00.731354 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb4c168-4a64-407f-bbb4-875a48ee375a None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:01:00.731596 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb4c168-4a64-407f-bbb4-875a48ee375a None None] PATH_INFO: `/` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:01:00.732982 dv-cinder-862365-1-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 125/244] 10.222.0.23 () {54 vars in 927 bytes} [Fri Oct 28 19:01:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 28 19:01:00.734139 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb4c168-4a64-407f-bbb4-875a48ee375a None None] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:01:00.746841 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dec073a-785c-4f65-a25c-5f4ad1d80546 None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:01:00.749197 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:01:00.782424 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b920017-901d-4402-9dd7-02a9a1b80c02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:01:00.783092 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b920017-901d-4402-9dd7-02a9a1b80c02 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:01:00.783645 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b920017-901d-4402-9dd7-02a9a1b80c02 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:01:00.783917 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b920017-901d-4402-9dd7-02a9a1b80c02 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:01:00.784994 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b920017-901d-4402-9dd7-02a9a1b80c02 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:01:00.786526 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b920017-901d-4402-9dd7-02a9a1b80c02 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:01:00.788083 dv-cinder-862365-1-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 120/245] 10.222.0.23 () {56 vars in 1108 bytes} [Fri Oct 28 19:01:00 2022] GET /identity/v3/domains/default => generated 199 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:01:00.789611 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba2fdf5-4029-44b1-8278-3eef5054e990 None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:01:00.789705 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba2fdf5-4029-44b1-8278-3eef5054e990 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:01:00.789917 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba2fdf5-4029-44b1-8278-3eef5054e990 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:01:00.807730 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-2ba2fdf5-4029-44b1-8278-3eef5054e990 None None] MFA Rules not processed for user `ae863915635746d1ac19970949de4722`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:01:00.808927 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-2ba2fdf5-4029-44b1-8278-3eef5054e990 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:01:00.917009 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb4c168-4a64-407f-bbb4-875a48ee375a None None] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:01:00.950560 dv-cinder-862365-1-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 121/246] 10.222.0.23 () {58 vars in 1024 bytes} [Fri Oct 28 19:01:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 28 19:01:00.950722 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec03350-1b87-466c-bd2e-5d73300a4f7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:01:00.951188 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec03350-1b87-466c-bd2e-5d73300a4f7c None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:01:00.951558 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec03350-1b87-466c-bd2e-5d73300a4f7c None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:01:00.951661 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba2fdf5-4029-44b1-8278-3eef5054e990 None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:01:00.951735 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec03350-1b87-466c-bd2e-5d73300a4f7c None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:01:00.962747 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec03350-1b87-466c-bd2e-5d73300a4f7c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 19:01:00.968295 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application [None req-0ec03350-1b87-466c-bd2e-5d73300a4f7c None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 28 19:01:00.968295 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 19:01:00.968295 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 19:01:00.968295 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 19:01:00.968295 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 19:01:00.968295 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 19:01:00.968295 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 19:01:00.968295 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 19:01:00.968295 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 19:01:00.968295 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 19:01:00.968295 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 19:01:00.968295 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 19:01:00.968295 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 28 19:01:00.968295 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 28 19:01:00.968295 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 28 19:01:00.968295 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 28 19:01:00.976049 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 28 19:01:00.976049 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 28 19:01:00.976049 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 28 19:01:00.976049 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 28 19:01:00.976049 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 19:01:00.976049 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 19:01:00.976049 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 19:01:00.976049 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 19:01:00.976049 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 19:01:00.976049 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 19:01:00.976049 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 19:01:00.976049 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application with Lock( Oct 28 19:01:00.976049 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 19:01:00.976049 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._enter() Oct 28 19:01:00.976049 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 19:01:00.976049 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 19:01:00.976870 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 19:01:00.976870 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.creator() Oct 28 19:01:00.976870 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 19:01:00.976870 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application created_value = creator( Oct 28 19:01:00.976870 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 28 19:01:00.976870 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 28 19:01:00.976870 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 28 19:01:00.976870 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 28 19:01:00.976870 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 28 19:01:00.976870 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 28 19:01:00.976870 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 28 19:01:00.976870 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application Oct 28 19:01:00.976870 dv-cinder-862365-1-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 126/247] 10.222.0.23 () {56 vars in 1099 bytes} [Fri Oct 28 19:01:00 2022] GET /identity/v3/roles/reader => generated 84 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 28 19:01:00.976870 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec03350-1b87-466c-bd2e-5d73300a4f7c None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:01:01.000426 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:01:01.108645 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba2fdf5-4029-44b1-8278-3eef5054e990 None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:01:01.110295 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:01:01.143492 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec03350-1b87-466c-bd2e-5d73300a4f7c None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:01:01.145248 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ddbef3-6bb0-4dd0-bade-66cb9f24c9ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:01:01.146144 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ddbef3-6bb0-4dd0-bade-66cb9f24c9ca None admin] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:01:01.146569 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ddbef3-6bb0-4dd0-bade-66cb9f24c9ca None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:01:01.147138 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ddbef3-6bb0-4dd0-bade-66cb9f24c9ca None admin] PATH_INFO: `/v3/groups` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:01:01.148423 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ddbef3-6bb0-4dd0-bade-66cb9f24c9ca None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:01:01.149249 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ddbef3-6bb0-4dd0-bade-66cb9f24c9ca None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:01:01.179225 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f5da7b-987f-4cd8-ba1f-f6c3465595c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:01:01.179764 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f5da7b-987f-4cd8-ba1f-f6c3465595c1 None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:01:01.180046 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f5da7b-987f-4cd8-ba1f-f6c3465595c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:01:01.180321 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f5da7b-987f-4cd8-ba1f-f6c3465595c1 None admin] PATH_INFO: `/v3/roles` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:01:01.180997 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f5da7b-987f-4cd8-ba1f-f6c3465595c1 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81765) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:01:01.181297 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f5da7b-987f-4cd8-ba1f-f6c3465595c1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:01:01.182711 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f5da7b-987f-4cd8-ba1f-f6c3465595c1 None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:01:01.191226 dv-cinder-862365-1-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 127/248] 10.222.0.23 () {56 vars in 1101 bytes} [Fri Oct 28 19:01:00 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 19:01:01.196659 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f5da7b-987f-4cd8-ba1f-f6c3465595c1 None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:01:01.225216 dv-cinder-862365-1-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 122/249] 10.222.0.23 () {60 vars in 1134 bytes} [Fri Oct 28 19:01:00 2022] POST /identity/v3/groups => generated 226 bytes in 274 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 19:01:01.226247 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ddbef3-6bb0-4dd0-bade-66cb9f24c9ca None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:01:01.286429 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:01:01.311634 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f5da7b-987f-4cd8-ba1f-f6c3465595c1 None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:01:01.338487 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ddbef3-6bb0-4dd0-bade-66cb9f24c9ca None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:01:01.352320 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295cd6f6-4a37-4ac9-b8cd-62e67b51ef08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:01:01.352965 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295cd6f6-4a37-4ac9-b8cd-62e67b51ef08 None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:01:01.353245 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295cd6f6-4a37-4ac9-b8cd-62e67b51ef08 None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:01:01.353551 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295cd6f6-4a37-4ac9-b8cd-62e67b51ef08 None admin] PATH_INFO: `/v3/users/fafe56e86c2d49b7977ac2f1c3fadc3c` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:01:01.354808 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295cd6f6-4a37-4ac9-b8cd-62e67b51ef08 None admin] RBAC: Authorizing `identity:get_user(user_id=fafe56e86c2d49b7977ac2f1c3fadc3c)` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:01:01.356304 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295cd6f6-4a37-4ac9-b8cd-62e67b51ef08 None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:01:01.358034 dv-cinder-862365-1-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 128/250] 10.222.0.23 () {56 vars in 1177 bytes} [Fri Oct 28 19:01:01 2022] GET /identity/v3/users/fafe56e86c2d49b7977ac2f1c3fadc3c => generated 293 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 19:01:01.363747 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295cd6f6-4a37-4ac9-b8cd-62e67b51ef08 None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:01:01.381339 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4f84c4-757b-471d-b749-91f0266d9acb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:01:01.382008 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4f84c4-757b-471d-b749-91f0266d9acb None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:01:01.382291 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4f84c4-757b-471d-b749-91f0266d9acb None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:01:01.382561 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4f84c4-757b-471d-b749-91f0266d9acb None admin] PATH_INFO: `/v3/roles/member` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:01:01.394412 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e4f84c4-757b-471d-b749-91f0266d9acb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 19:01:01.399805 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application [None req-3e4f84c4-757b-471d-b749-91f0266d9acb None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 28 19:01:01.399805 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 19:01:01.399805 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 19:01:01.399805 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 19:01:01.399805 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 19:01:01.399805 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 19:01:01.399805 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 19:01:01.399805 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 19:01:01.399805 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 19:01:01.399805 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 19:01:01.399805 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 19:01:01.399805 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 19:01:01.399805 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 28 19:01:01.399805 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 28 19:01:01.399805 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 28 19:01:01.399805 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 28 19:01:01.400868 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 28 19:01:01.400868 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 28 19:01:01.400868 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 28 19:01:01.400868 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 28 19:01:01.400868 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 19:01:01.400868 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 19:01:01.400868 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 19:01:01.400868 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 19:01:01.400868 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 19:01:01.400868 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 19:01:01.400868 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 19:01:01.400868 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application with Lock( Oct 28 19:01:01.400868 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 19:01:01.400868 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._enter() Oct 28 19:01:01.400868 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 19:01:01.400868 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 19:01:01.401747 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 19:01:01.401747 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.creator() Oct 28 19:01:01.401747 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 19:01:01.401747 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application created_value = creator( Oct 28 19:01:01.401747 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 28 19:01:01.401747 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 28 19:01:01.401747 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 28 19:01:01.401747 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 28 19:01:01.401747 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 28 19:01:01.401747 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 28 19:01:01.401747 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 28 19:01:01.401747 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Oct 28 19:01:01.401747 dv-cinder-862365-1-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 123/251] 10.222.0.23 () {56 vars in 1099 bytes} [Fri Oct 28 19:01:01 2022] GET /identity/v3/roles/member => generated 84 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 19:01:01.406997 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4f84c4-757b-471d-b749-91f0266d9acb None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:01:01.447659 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:01:01.496810 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295cd6f6-4a37-4ac9-b8cd-62e67b51ef08 None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:01:01.542985 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4f84c4-757b-471d-b749-91f0266d9acb None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:01:01.543926 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4f2b09-d944-431a-8d06-2e94767e4a28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:01:01.544947 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4f2b09-d944-431a-8d06-2e94767e4a28 None admin] REQUEST_METHOD: `PUT` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:01:01.545537 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4f2b09-d944-431a-8d06-2e94767e4a28 None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:01:01.545817 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4f2b09-d944-431a-8d06-2e94767e4a28 None admin] PATH_INFO: `/v3/system/users/fafe56e86c2d49b7977ac2f1c3fadc3c/roles/ba7a86f4918e49709c1bae8d5942bf42` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:01:01.548121 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4f2b09-d944-431a-8d06-2e94767e4a28 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=fafe56e86c2d49b7977ac2f1c3fadc3c, role_id=ba7a86f4918e49709c1bae8d5942bf42)` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:01:01.549571 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4f2b09-d944-431a-8d06-2e94767e4a28 None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:01:01.580451 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c067eaf7-7a10-4c76-924a-17b5522ed172 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:01:01.581063 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c067eaf7-7a10-4c76-924a-17b5522ed172 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:01:01.581389 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c067eaf7-7a10-4c76-924a-17b5522ed172 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:01:01.581650 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c067eaf7-7a10-4c76-924a-17b5522ed172 None admin] PATH_INFO: `/v3/roles` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:01:01.582354 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c067eaf7-7a10-4c76-924a-17b5522ed172 None admin] RBAC: Adding query filter params (name=member) {{(pid=81766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:01:01.582631 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c067eaf7-7a10-4c76-924a-17b5522ed172 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:01:01.584014 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c067eaf7-7a10-4c76-924a-17b5522ed172 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:01:01.593134 dv-cinder-862365-1-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 124/252] 10.222.0.23 () {56 vars in 1101 bytes} [Fri Oct 28 19:01:01 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 19:01:01.598609 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c067eaf7-7a10-4c76-924a-17b5522ed172 None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:01:01.607845 dv-cinder-862365-1-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 129/253] 10.222.0.23 () {58 vars in 1334 bytes} [Fri Oct 28 19:01:01 2022] PUT /identity/v3/system/users/fafe56e86c2d49b7977ac2f1c3fadc3c/roles/ba7a86f4918e49709c1bae8d5942bf42 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 19:01:01.701306 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:01:01.723436 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c067eaf7-7a10-4c76-924a-17b5522ed172 None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:01:01.764050 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900643d8-5e5a-415e-84f7-30222f06b3cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:01:01.765063 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900643d8-5e5a-415e-84f7-30222f06b3cd None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:01:01.765516 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900643d8-5e5a-415e-84f7-30222f06b3cd None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:01:01.765953 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900643d8-5e5a-415e-84f7-30222f06b3cd None admin] PATH_INFO: `/v3/users/a0a243512b104f64b276487fbbfb8d15` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:01:01.767381 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900643d8-5e5a-415e-84f7-30222f06b3cd None admin] RBAC: Authorizing `identity:get_user(user_id=a0a243512b104f64b276487fbbfb8d15)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:01:01.769025 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900643d8-5e5a-415e-84f7-30222f06b3cd None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:01:01.771209 dv-cinder-862365-1-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 125/254] 10.222.0.23 () {56 vars in 1177 bytes} [Fri Oct 28 19:01:01 2022] GET /identity/v3/users/a0a243512b104f64b276487fbbfb8d15 => generated 293 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 19:01:01.780286 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4f2b09-d944-431a-8d06-2e94767e4a28 None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:01:01.801429 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:01:01.896282 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4f2b09-d944-431a-8d06-2e94767e4a28 None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:01:01.933196 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91f0111-7f6a-4d14-a2a5-676fdeab77d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:01:01.933850 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91f0111-7f6a-4d14-a2a5-676fdeab77d3 None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:01:01.934131 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91f0111-7f6a-4d14-a2a5-676fdeab77d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:01:01.934403 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91f0111-7f6a-4d14-a2a5-676fdeab77d3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:01:01.935131 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91f0111-7f6a-4d14-a2a5-676fdeab77d3 None admin] RBAC: Adding query filter params (role.id=c193f661c7504bdf80c036f745eba59b, user.id=a0a243512b104f64b276487fbbfb8d15, scope.system=all) {{(pid=81765) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:01:01.935439 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91f0111-7f6a-4d14-a2a5-676fdeab77d3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:01:01.936872 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91f0111-7f6a-4d14-a2a5-676fdeab77d3 None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:01:01.949721 dv-cinder-862365-1-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 130/255] 10.222.0.23 () {56 vars in 1308 bytes} [Fri Oct 28 19:01:01 2022] GET /identity/v3/role_assignments?user.id=a0a243512b104f64b276487fbbfb8d15&scope.system=all&role.id=c193f661c7504bdf80c036f745eba59b => generated 510 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:01:03.598112 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0285de-4ead-4c96-8cd1-f0c25dd8b666 None None] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:01:03.598626 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0285de-4ead-4c96-8cd1-f0c25dd8b666 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:01:03.598732 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0285de-4ead-4c96-8cd1-f0c25dd8b666 None None] PATH_INFO: `/` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:01:03.600275 dv-cinder-862365-1-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 126/256] 10.222.0.23 () {54 vars in 927 bytes} [Fri Oct 28 19:01:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 19:01:03.605940 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd11e4c3-413d-435f-9603-af0f7fc17804 None None] REQUEST_METHOD: `POST` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:01:03.606386 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd11e4c3-413d-435f-9603-af0f7fc17804 None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:01:03.606572 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd11e4c3-413d-435f-9603-af0f7fc17804 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:01:03.627187 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.auth.core [None req-bd11e4c3-413d-435f-9603-af0f7fc17804 None None] MFA Rules not processed for user `ae863915635746d1ac19970949de4722`. Rule list: `[]` (Enabled: `True`). {{(pid=81765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:01:03.628380 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-bd11e4c3-413d-435f-9603-af0f7fc17804 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:01:03.701467 dv-cinder-862365-1-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 131/257] 10.222.0.23 () {58 vars in 1024 bytes} [Fri Oct 28 19:01:03 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Oct 28 19:01:04.038894 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0285de-4ead-4c96-8cd1-f0c25dd8b666 None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:01:04.053381 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1c7f12-1803-4bbe-8a79-4720ead3fb32 None None] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:01:04.053703 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1c7f12-1803-4bbe-8a79-4720ead3fb32 None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:01:04.053939 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1c7f12-1803-4bbe-8a79-4720ead3fb32 None None] PATH_INFO: `/` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:01:04.055566 dv-cinder-862365-1-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 132/258] 10.222.0.23 () {54 vars in 927 bytes} [Fri Oct 28 19:01:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 19:01:04.058622 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0285de-4ead-4c96-8cd1-f0c25dd8b666 None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:01:04.061448 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69efaa4f-befa-44c2-8af3-d721737751c4 None None] REQUEST_METHOD: `POST` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:01:04.061733 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69efaa4f-befa-44c2-8af3-d721737751c4 None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:01:04.062002 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69efaa4f-befa-44c2-8af3-d721737751c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:01:04.063214 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5778f86f-0f4b-4e5d-be49-76f6dfdb80d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b7477232f9249b8beb26277f784d073', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:01:04.063846 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5778f86f-0f4b-4e5d-be49-76f6dfdb80d4 admin admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:01:04.064191 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5778f86f-0f4b-4e5d-be49-76f6dfdb80d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:01:04.064469 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5778f86f-0f4b-4e5d-be49-76f6dfdb80d4 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:01:04.084439 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5778f86f-0f4b-4e5d-be49-76f6dfdb80d4 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 19:01:04.089661 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application [None req-5778f86f-0f4b-4e5d-be49-76f6dfdb80d4 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 28 19:01:04.089661 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 19:01:04.089661 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 19:01:04.089661 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 19:01:04.089661 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 19:01:04.089661 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 19:01:04.089661 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 19:01:04.089661 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 19:01:04.089661 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 19:01:04.089661 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 19:01:04.089661 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 19:01:04.089661 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 19:01:04.089661 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 28 19:01:04.089661 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 28 19:01:04.089661 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 28 19:01:04.089661 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 28 19:01:04.090539 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 28 19:01:04.090539 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 28 19:01:04.090539 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 28 19:01:04.090539 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 28 19:01:04.090539 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 19:01:04.090539 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 19:01:04.090539 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 19:01:04.090539 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 19:01:04.090539 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 19:01:04.090539 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 19:01:04.090539 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 19:01:04.090539 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application with Lock( Oct 28 19:01:04.090539 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 19:01:04.090539 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._enter() Oct 28 19:01:04.090539 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 19:01:04.090539 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 19:01:04.091316 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 19:01:04.091316 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.creator() Oct 28 19:01:04.091316 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 19:01:04.091316 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application created_value = creator( Oct 28 19:01:04.091316 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 28 19:01:04.091316 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 28 19:01:04.091316 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 28 19:01:04.091316 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 28 19:01:04.091316 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 28 19:01:04.091316 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 28 19:01:04.091316 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 28 19:01:04.091316 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Oct 28 19:01:04.094792 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.auth.core [None req-69efaa4f-befa-44c2-8af3-d721737751c4 None None] MFA Rules not processed for user `ae863915635746d1ac19970949de4722`. Rule list: `[]` (Enabled: `True`). {{(pid=81765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:01:04.095976 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-69efaa4f-befa-44c2-8af3-d721737751c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:01:04.103458 dv-cinder-862365-1-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 127/259] 10.222.0.23 () {56 vars in 1120 bytes} [Fri Oct 28 19:01:04 2022] GET /identity/v3/roles/member => generated 84 bytes in 64 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 19:01:04.105732 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5778f86f-0f4b-4e5d-be49-76f6dfdb80d4 admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:01:04.123896 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5778f86f-0f4b-4e5d-be49-76f6dfdb80d4 admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:01:04.127393 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:01:04.138050 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e464045-d3e7-4de2-a807-ef91acc94c94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b7477232f9249b8beb26277f784d073', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:01:04.138660 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e464045-d3e7-4de2-a807-ef91acc94c94 admin admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:01:04.139002 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e464045-d3e7-4de2-a807-ef91acc94c94 admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:01:04.139274 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e464045-d3e7-4de2-a807-ef91acc94c94 admin admin] PATH_INFO: `/v3/roles` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:01:04.139939 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e464045-d3e7-4de2-a807-ef91acc94c94 admin admin] RBAC: Adding query filter params (name=member) {{(pid=81766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:01:04.141517 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e464045-d3e7-4de2-a807-ef91acc94c94 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:01:04.143356 dv-cinder-862365-1-smb devstack@keystone.service[81766]: WARNING py.warnings [None req-4e464045-d3e7-4de2-a807-ef91acc94c94 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 19:01:04.143356 dv-cinder-862365-1-smb devstack@keystone.service[81766]: warnings.warn(msg) Oct 28 19:01:04.143356 dv-cinder-862365-1-smb devstack@keystone.service[81766]: Oct 28 19:01:04.147377 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e464045-d3e7-4de2-a807-ef91acc94c94 admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:01:04.161114 dv-cinder-862365-1-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 128/260] 10.222.0.23 () {56 vars in 1122 bytes} [Fri Oct 28 19:01:04 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 19:01:04.179709 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e464045-d3e7-4de2-a807-ef91acc94c94 admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:01:04.197027 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e464045-d3e7-4de2-a807-ef91acc94c94 admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:01:04.206611 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967d49b6-d374-4f4a-8d3e-5bbf0f520aea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b7477232f9249b8beb26277f784d073', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:01:04.207260 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967d49b6-d374-4f4a-8d3e-5bbf0f520aea admin admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:01:04.207538 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967d49b6-d374-4f4a-8d3e-5bbf0f520aea admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:01:04.207808 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967d49b6-d374-4f4a-8d3e-5bbf0f520aea admin admin] PATH_INFO: `/v3/groups/b9cd1ff07b954a08860e9a9837c816b3` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:01:04.217053 dv-cinder-862365-1-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 133/261] 10.222.0.23 () {58 vars in 1024 bytes} [Fri Oct 28 19:01:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 28 19:01:04.217734 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967d49b6-d374-4f4a-8d3e-5bbf0f520aea admin admin] RBAC: Authorizing `identity:get_group(group_id=b9cd1ff07b954a08860e9a9837c816b3)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:01:04.218895 dv-cinder-862365-1-smb devstack@keystone.service[81766]: WARNING py.warnings [None req-967d49b6-d374-4f4a-8d3e-5bbf0f520aea admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_group": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 28 19:01:04.218895 dv-cinder-862365-1-smb devstack@keystone.service[81766]: warnings.warn(msg) Oct 28 19:01:04.218895 dv-cinder-862365-1-smb devstack@keystone.service[81766]: Oct 28 19:01:04.220217 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967d49b6-d374-4f4a-8d3e-5bbf0f520aea admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:01:04.223652 dv-cinder-862365-1-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 129/262] 10.222.0.23 () {56 vars in 1201 bytes} [Fri Oct 28 19:01:04 2022] GET /identity/v3/groups/b9cd1ff07b954a08860e9a9837c816b3 => generated 226 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:01:04.231309 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69efaa4f-befa-44c2-8af3-d721737751c4 None None] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:01:04.250410 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69efaa4f-befa-44c2-8af3-d721737751c4 None None] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:01:04.259490 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257e512d-f442-468e-a722-178a960db08f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b7477232f9249b8beb26277f784d073', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:01:04.260193 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257e512d-f442-468e-a722-178a960db08f admin admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:01:04.260476 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257e512d-f442-468e-a722-178a960db08f admin admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:01:04.260787 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257e512d-f442-468e-a722-178a960db08f admin admin] PATH_INFO: `/v3/projects/575e6206099b4a24bc9b829f3e7b6bdc` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:01:04.263139 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257e512d-f442-468e-a722-178a960db08f admin admin] RBAC: Authorizing `identity:get_project(project_id=575e6206099b4a24bc9b829f3e7b6bdc)` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:01:04.265471 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257e512d-f442-468e-a722-178a960db08f admin admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:01:04.267442 dv-cinder-862365-1-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 134/263] 10.222.0.23 () {56 vars in 1207 bytes} [Fri Oct 28 19:01:04 2022] GET /identity/v3/projects/575e6206099b4a24bc9b829f3e7b6bdc => generated 298 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:01:04.273068 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967d49b6-d374-4f4a-8d3e-5bbf0f520aea admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:01:04.291537 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967d49b6-d374-4f4a-8d3e-5bbf0f520aea admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:01:04.301974 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04dc4b40-2a39-4d2e-b6b9-6215537ffb2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b7477232f9249b8beb26277f784d073', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:01:04.302636 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04dc4b40-2a39-4d2e-b6b9-6215537ffb2c admin admin] REQUEST_METHOD: `PUT` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:01:04.302915 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04dc4b40-2a39-4d2e-b6b9-6215537ffb2c admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:01:04.303185 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04dc4b40-2a39-4d2e-b6b9-6215537ffb2c admin admin] PATH_INFO: `/v3/projects/575e6206099b4a24bc9b829f3e7b6bdc/groups/b9cd1ff07b954a08860e9a9837c816b3/roles/c193f661c7504bdf80c036f745eba59b` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:01:04.305061 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04dc4b40-2a39-4d2e-b6b9-6215537ffb2c admin admin] RBAC: Authorizing `identity:create_grant(project_id=575e6206099b4a24bc9b829f3e7b6bdc, group_id=b9cd1ff07b954a08860e9a9837c816b3, role_id=c193f661c7504bdf80c036f745eba59b)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:01:04.306157 dv-cinder-862365-1-smb devstack@keystone.service[81766]: WARNING py.warnings [None req-04dc4b40-2a39-4d2e-b6b9-6215537ffb2c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 28 19:01:04.306157 dv-cinder-862365-1-smb devstack@keystone.service[81766]: warnings.warn(msg) Oct 28 19:01:04.306157 dv-cinder-862365-1-smb devstack@keystone.service[81766]: Oct 28 19:01:04.308153 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04dc4b40-2a39-4d2e-b6b9-6215537ffb2c admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:01:04.409583 dv-cinder-862365-1-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 130/264] 10.222.0.23 () {58 vars in 1463 bytes} [Fri Oct 28 19:01:04 2022] PUT /identity/v3/projects/575e6206099b4a24bc9b829f3e7b6bdc/groups/b9cd1ff07b954a08860e9a9837c816b3/roles/c193f661c7504bdf80c036f745eba59b => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 19:01:04.589676 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257e512d-f442-468e-a722-178a960db08f admin admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:01:04.715972 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257e512d-f442-468e-a722-178a960db08f admin admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:01:04.765780 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e3be8d-968b-4215-85c9-da7a0b58b8c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:01:04.766424 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e3be8d-968b-4215-85c9-da7a0b58b8c2 None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:01:04.766702 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e3be8d-968b-4215-85c9-da7a0b58b8c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:01:04.766974 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e3be8d-968b-4215-85c9-da7a0b58b8c2 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:01:04.788610 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e3be8d-968b-4215-85c9-da7a0b58b8c2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 19:01:04.792320 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48a0efa-647c-4f1d-959e-bd1c3e04168c None None] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:01:04.792832 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48a0efa-647c-4f1d-959e-bd1c3e04168c None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:01:04.792832 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48a0efa-647c-4f1d-959e-bd1c3e04168c None None] PATH_INFO: `/` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:01:04.794492 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application [None req-93e3be8d-968b-4215-85c9-da7a0b58b8c2 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 28 19:01:04.794492 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 19:01:04.794492 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 19:01:04.794492 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 19:01:04.794492 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 19:01:04.794492 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 19:01:04.794492 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 19:01:04.794492 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 19:01:04.794492 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 19:01:04.794492 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 19:01:04.794492 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 19:01:04.794492 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 19:01:04.794492 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 28 19:01:04.794492 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 28 19:01:04.794492 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 28 19:01:04.794492 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 28 19:01:04.800904 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 28 19:01:04.800904 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 28 19:01:04.800904 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 28 19:01:04.800904 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 28 19:01:04.800904 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 19:01:04.800904 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 19:01:04.800904 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 19:01:04.800904 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 19:01:04.800904 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 19:01:04.800904 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 19:01:04.800904 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 19:01:04.800904 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application with Lock( Oct 28 19:01:04.800904 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 19:01:04.800904 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._enter() Oct 28 19:01:04.800904 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 19:01:04.800904 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 19:01:04.802686 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 19:01:04.802686 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.creator() Oct 28 19:01:04.802686 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 19:01:04.802686 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application created_value = creator( Oct 28 19:01:04.802686 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 28 19:01:04.802686 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 28 19:01:04.802686 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 28 19:01:04.802686 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 28 19:01:04.802686 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 28 19:01:04.802686 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 28 19:01:04.802686 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 28 19:01:04.802686 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application Oct 28 19:01:04.803987 dv-cinder-862365-1-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 131/265] 10.222.0.23 () {54 vars in 927 bytes} [Fri Oct 28 19:01:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 19:01:04.804115 dv-cinder-862365-1-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 135/266] 10.222.0.23 () {56 vars in 1099 bytes} [Fri Oct 28 19:01:04 2022] GET /identity/v3/roles/reader => generated 84 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 19:01:04.804239 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d482d3-98d4-46a9-a109-79af2b6fcfaa None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:01:04.804239 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d482d3-98d4-46a9-a109-79af2b6fcfaa None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:01:04.804239 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d482d3-98d4-46a9-a109-79af2b6fcfaa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:01:04.809395 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e3be8d-968b-4215-85c9-da7a0b58b8c2 None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:01:04.815008 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:01:04.837398 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-04d482d3-98d4-46a9-a109-79af2b6fcfaa None None] MFA Rules not processed for user `ae863915635746d1ac19970949de4722`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:01:04.838520 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-04d482d3-98d4-46a9-a109-79af2b6fcfaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:01:04.933343 dv-cinder-862365-1-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 132/267] 10.222.0.23 () {58 vars in 1024 bytes} [Fri Oct 28 19:01:04 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Oct 28 19:01:04.934828 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859826e2-ca30-4197-890c-08e943e62d59 None None] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:01:04.935442 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859826e2-ca30-4197-890c-08e943e62d59 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:01:04.935731 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859826e2-ca30-4197-890c-08e943e62d59 None None] PATH_INFO: `/` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:01:04.937027 dv-cinder-862365-1-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 133/268] 10.222.0.23 () {54 vars in 927 bytes} [Fri Oct 28 19:01:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 19:01:04.942909 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f08d04-cee3-4d0f-99f1-e4cfcd4489b6 None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:01:04.943241 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f08d04-cee3-4d0f-99f1-e4cfcd4489b6 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:01:04.943462 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f08d04-cee3-4d0f-99f1-e4cfcd4489b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:01:04.959908 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e3be8d-968b-4215-85c9-da7a0b58b8c2 None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:01:04.967873 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-59f08d04-cee3-4d0f-99f1-e4cfcd4489b6 None None] MFA Rules not processed for user `ae863915635746d1ac19970949de4722`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:01:04.969074 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-59f08d04-cee3-4d0f-99f1-e4cfcd4489b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:01:04.987114 dv-cinder-862365-1-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 134/269] 10.222.0.23 () {58 vars in 1024 bytes} [Fri Oct 28 19:01:04 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Oct 28 19:01:05.009782 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac9d30d-ab2e-430b-b6ea-a20124bbd331 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:01:05.010455 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac9d30d-ab2e-430b-b6ea-a20124bbd331 None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:01:05.010778 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac9d30d-ab2e-430b-b6ea-a20124bbd331 None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:01:05.011108 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac9d30d-ab2e-430b-b6ea-a20124bbd331 None admin] PATH_INFO: `/v3/roles` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:01:05.011788 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac9d30d-ab2e-430b-b6ea-a20124bbd331 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81765) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:01:05.012095 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac9d30d-ab2e-430b-b6ea-a20124bbd331 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:01:05.013675 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac9d30d-ab2e-430b-b6ea-a20124bbd331 None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:01:05.023578 dv-cinder-862365-1-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 136/270] 10.222.0.23 () {56 vars in 1101 bytes} [Fri Oct 28 19:01:04 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:01:05.029741 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f08d04-cee3-4d0f-99f1-e4cfcd4489b6 None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:01:05.099828 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:01:05.156649 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f08d04-cee3-4d0f-99f1-e4cfcd4489b6 None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:01:05.200990 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787825df-81f3-489e-ab4d-aedb08e703fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:01:05.201808 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787825df-81f3-489e-ab4d-aedb08e703fd None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:01:05.202094 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787825df-81f3-489e-ab4d-aedb08e703fd None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:01:05.202376 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787825df-81f3-489e-ab4d-aedb08e703fd None admin] PATH_INFO: `/v3/users/fafe56e86c2d49b7977ac2f1c3fadc3c` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:01:05.203556 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787825df-81f3-489e-ab4d-aedb08e703fd None admin] RBAC: Authorizing `identity:get_user(user_id=fafe56e86c2d49b7977ac2f1c3fadc3c)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:01:05.205006 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787825df-81f3-489e-ab4d-aedb08e703fd None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:01:05.207008 dv-cinder-862365-1-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 135/271] 10.222.0.23 () {56 vars in 1177 bytes} [Fri Oct 28 19:01:05 2022] GET /identity/v3/users/fafe56e86c2d49b7977ac2f1c3fadc3c => generated 293 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:01:05.212656 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac9d30d-ab2e-430b-b6ea-a20124bbd331 None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:01:05.286728 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:01:05.324283 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac9d30d-ab2e-430b-b6ea-a20124bbd331 None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:01:05.360559 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca31cf3-3465-4a97-b4cf-bba87db02801 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:01:05.361093 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca31cf3-3465-4a97-b4cf-bba87db02801 None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:01:05.361399 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca31cf3-3465-4a97-b4cf-bba87db02801 None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:01:05.361742 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca31cf3-3465-4a97-b4cf-bba87db02801 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:01:05.362480 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca31cf3-3465-4a97-b4cf-bba87db02801 None admin] RBAC: Adding query filter params (role.id=ba7a86f4918e49709c1bae8d5942bf42, user.id=fafe56e86c2d49b7977ac2f1c3fadc3c, scope.system=all) {{(pid=81765) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:01:05.362795 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca31cf3-3465-4a97-b4cf-bba87db02801 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:01:05.364241 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca31cf3-3465-4a97-b4cf-bba87db02801 None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:01:05.369168 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787825df-81f3-489e-ab4d-aedb08e703fd None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:01:05.383088 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787825df-81f3-489e-ab4d-aedb08e703fd None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:01:05.383560 dv-cinder-862365-1-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 137/272] 10.222.0.23 () {56 vars in 1308 bytes} [Fri Oct 28 19:01:05 2022] GET /identity/v3/role_assignments?user.id=fafe56e86c2d49b7977ac2f1c3fadc3c&scope.system=all&role.id=ba7a86f4918e49709c1bae8d5942bf42 => generated 510 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:01:05.388444 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788f232a-d0dc-4c8a-8e10-0a3775cba4b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b7477232f9249b8beb26277f784d073', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:01:05.389099 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788f232a-d0dc-4c8a-8e10-0a3775cba4b5 admin admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:01:05.389481 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788f232a-d0dc-4c8a-8e10-0a3775cba4b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:01:05.389760 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788f232a-d0dc-4c8a-8e10-0a3775cba4b5 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:01:05.405571 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788f232a-d0dc-4c8a-8e10-0a3775cba4b5 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 19:01:05.410868 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application [None req-788f232a-d0dc-4c8a-8e10-0a3775cba4b5 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 28 19:01:05.410868 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 19:01:05.410868 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 19:01:05.410868 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 19:01:05.410868 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 19:01:05.410868 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 19:01:05.410868 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 19:01:05.410868 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 19:01:05.410868 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 19:01:05.410868 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 19:01:05.410868 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 19:01:05.410868 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 19:01:05.410868 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 28 19:01:05.410868 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 28 19:01:05.410868 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 28 19:01:05.410868 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 28 19:01:05.411842 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 28 19:01:05.411842 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 28 19:01:05.411842 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 28 19:01:05.411842 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 28 19:01:05.411842 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 19:01:05.411842 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 19:01:05.411842 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 19:01:05.411842 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 19:01:05.411842 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 19:01:05.411842 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 19:01:05.411842 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 19:01:05.411842 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application with Lock( Oct 28 19:01:05.411842 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 19:01:05.411842 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._enter() Oct 28 19:01:05.411842 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 19:01:05.411842 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 19:01:05.413050 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 19:01:05.413050 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.creator() Oct 28 19:01:05.413050 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 19:01:05.413050 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application created_value = creator( Oct 28 19:01:05.413050 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 28 19:01:05.413050 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 28 19:01:05.413050 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 28 19:01:05.413050 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 28 19:01:05.413050 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 28 19:01:05.413050 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 28 19:01:05.413050 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 28 19:01:05.413050 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Oct 28 19:01:05.413050 dv-cinder-862365-1-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 136/273] 10.222.0.23 () {56 vars in 1135 bytes} [Fri Oct 28 19:01:05 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 19:01:05.418797 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca31cf3-3465-4a97-b4cf-bba87db02801 None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:01:05.437585 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca31cf3-3465-4a97-b4cf-bba87db02801 None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:01:05.442370 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057e5d26-92e1-43e7-b0f7-2d4944dc7443 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b7477232f9249b8beb26277f784d073', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:01:05.443000 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057e5d26-92e1-43e7-b0f7-2d4944dc7443 admin admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:01:05.443283 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057e5d26-92e1-43e7-b0f7-2d4944dc7443 admin admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:01:05.443560 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057e5d26-92e1-43e7-b0f7-2d4944dc7443 admin admin] PATH_INFO: `/v3/roles` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:01:05.444250 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-057e5d26-92e1-43e7-b0f7-2d4944dc7443 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81765) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:01:05.444618 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-057e5d26-92e1-43e7-b0f7-2d4944dc7443 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:01:05.446632 dv-cinder-862365-1-smb devstack@keystone.service[81765]: WARNING py.warnings [None req-057e5d26-92e1-43e7-b0f7-2d4944dc7443 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 19:01:05.446632 dv-cinder-862365-1-smb devstack@keystone.service[81765]: warnings.warn(msg) Oct 28 19:01:05.446632 dv-cinder-862365-1-smb devstack@keystone.service[81765]: Oct 28 19:01:05.447594 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-057e5d26-92e1-43e7-b0f7-2d4944dc7443 admin admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:01:05.459047 dv-cinder-862365-1-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 138/274] 10.222.0.23 () {56 vars in 1132 bytes} [Fri Oct 28 19:01:05 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:01:05.465019 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788f232a-d0dc-4c8a-8e10-0a3775cba4b5 admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:01:05.476348 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788f232a-d0dc-4c8a-8e10-0a3775cba4b5 admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:01:05.485911 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078bd6bd-23b3-40d6-bc26-de24032742b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b7477232f9249b8beb26277f784d073', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:01:05.486927 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078bd6bd-23b3-40d6-bc26-de24032742b8 admin admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:01:05.487215 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078bd6bd-23b3-40d6-bc26-de24032742b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:01:05.487489 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078bd6bd-23b3-40d6-bc26-de24032742b8 admin admin] PATH_INFO: `/v3/groups/b9cd1ff07b954a08860e9a9837c816b3` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:01:05.488701 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078bd6bd-23b3-40d6-bc26-de24032742b8 admin admin] RBAC: Authorizing `identity:get_group(group_id=b9cd1ff07b954a08860e9a9837c816b3)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:01:05.491026 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078bd6bd-23b3-40d6-bc26-de24032742b8 admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:01:05.492829 dv-cinder-862365-1-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 137/275] 10.222.0.23 () {56 vars in 1201 bytes} [Fri Oct 28 19:01:05 2022] GET /identity/v3/groups/b9cd1ff07b954a08860e9a9837c816b3 => generated 226 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:01:05.499532 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057e5d26-92e1-43e7-b0f7-2d4944dc7443 admin admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:01:05.511114 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057e5d26-92e1-43e7-b0f7-2d4944dc7443 admin admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:01:05.515728 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b24622-a5ba-4748-87e4-b46ed8910971 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b7477232f9249b8beb26277f784d073', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:01:05.516802 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b24622-a5ba-4748-87e4-b46ed8910971 admin admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:01:05.517145 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b24622-a5ba-4748-87e4-b46ed8910971 admin admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:01:05.517457 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b24622-a5ba-4748-87e4-b46ed8910971 admin admin] PATH_INFO: `/v3/projects/575e6206099b4a24bc9b829f3e7b6bdc` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:01:05.518650 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b24622-a5ba-4748-87e4-b46ed8910971 admin admin] RBAC: Authorizing `identity:get_project(project_id=575e6206099b4a24bc9b829f3e7b6bdc)` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:01:05.521017 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b24622-a5ba-4748-87e4-b46ed8910971 admin admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:01:05.523231 dv-cinder-862365-1-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 139/276] 10.222.0.23 () {56 vars in 1207 bytes} [Fri Oct 28 19:01:05 2022] GET /identity/v3/projects/575e6206099b4a24bc9b829f3e7b6bdc => generated 298 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:01:05.529185 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078bd6bd-23b3-40d6-bc26-de24032742b8 admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:01:05.540766 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078bd6bd-23b3-40d6-bc26-de24032742b8 admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:01:05.541648 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b24622-a5ba-4748-87e4-b46ed8910971 admin admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:01:05.551673 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4707622e-a3e6-44a1-bf72-147b28aa607d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b7477232f9249b8beb26277f784d073', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:01:05.552362 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4707622e-a3e6-44a1-bf72-147b28aa607d admin admin] REQUEST_METHOD: `PUT` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:01:05.552642 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4707622e-a3e6-44a1-bf72-147b28aa607d admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:01:05.552914 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4707622e-a3e6-44a1-bf72-147b28aa607d admin admin] PATH_INFO: `/v3/projects/575e6206099b4a24bc9b829f3e7b6bdc/groups/b9cd1ff07b954a08860e9a9837c816b3/roles/a11a1b300fe044b5a905284bc623dc41` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:01:05.561176 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b24622-a5ba-4748-87e4-b46ed8910971 admin admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:01:05.562190 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4707622e-a3e6-44a1-bf72-147b28aa607d admin admin] RBAC: Authorizing `identity:create_grant(project_id=575e6206099b4a24bc9b829f3e7b6bdc, group_id=b9cd1ff07b954a08860e9a9837c816b3, role_id=a11a1b300fe044b5a905284bc623dc41)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:01:05.565862 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4707622e-a3e6-44a1-bf72-147b28aa607d admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:01:05.572866 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275c01fd-b1ce-4d94-8679-e31c4b29e8d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b7477232f9249b8beb26277f784d073', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:01:05.574258 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275c01fd-b1ce-4d94-8679-e31c4b29e8d5 admin admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:01:05.574542 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275c01fd-b1ce-4d94-8679-e31c4b29e8d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:01:05.575232 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275c01fd-b1ce-4d94-8679-e31c4b29e8d5 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:01:05.589039 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275c01fd-b1ce-4d94-8679-e31c4b29e8d5 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 19:01:05.594443 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application [None req-275c01fd-b1ce-4d94-8679-e31c4b29e8d5 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 28 19:01:05.594443 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 19:01:05.594443 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 19:01:05.594443 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 19:01:05.594443 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 19:01:05.594443 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 19:01:05.594443 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 19:01:05.594443 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 19:01:05.594443 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 19:01:05.594443 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 19:01:05.594443 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 19:01:05.594443 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 19:01:05.594443 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 28 19:01:05.594443 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 28 19:01:05.594443 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 28 19:01:05.594443 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 28 19:01:05.600078 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 28 19:01:05.600078 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 28 19:01:05.600078 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 28 19:01:05.600078 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 28 19:01:05.600078 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 19:01:05.600078 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 19:01:05.600078 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 19:01:05.600078 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 19:01:05.600078 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 19:01:05.600078 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 19:01:05.600078 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 19:01:05.600078 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application with Lock( Oct 28 19:01:05.600078 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 19:01:05.600078 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._enter() Oct 28 19:01:05.600078 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 19:01:05.600078 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 19:01:05.602286 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 19:01:05.602286 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.creator() Oct 28 19:01:05.602286 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 19:01:05.602286 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application created_value = creator( Oct 28 19:01:05.602286 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 28 19:01:05.602286 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 28 19:01:05.602286 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 28 19:01:05.602286 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 28 19:01:05.602286 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 28 19:01:05.602286 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 28 19:01:05.602286 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 28 19:01:05.602286 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application Oct 28 19:01:05.602286 dv-cinder-862365-1-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 140/277] 10.222.0.23 () {56 vars in 1120 bytes} [Fri Oct 28 19:01:05 2022] GET /identity/v3/roles/member => generated 84 bytes in 58 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 19:01:05.608177 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275c01fd-b1ce-4d94-8679-e31c4b29e8d5 admin admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:01:05.619367 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275c01fd-b1ce-4d94-8679-e31c4b29e8d5 admin admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:01:05.624710 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66f593e-2b24-42b4-b91d-83a8575edbf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b7477232f9249b8beb26277f784d073', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:01:05.625319 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66f593e-2b24-42b4-b91d-83a8575edbf1 admin admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:01:05.625667 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66f593e-2b24-42b4-b91d-83a8575edbf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:01:05.625941 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66f593e-2b24-42b4-b91d-83a8575edbf1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:01:05.626618 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66f593e-2b24-42b4-b91d-83a8575edbf1 admin admin] RBAC: Adding query filter params (name=member) {{(pid=81765) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:01:05.626973 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66f593e-2b24-42b4-b91d-83a8575edbf1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:01:05.628704 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66f593e-2b24-42b4-b91d-83a8575edbf1 admin admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:01:05.638639 dv-cinder-862365-1-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 141/278] 10.222.0.23 () {56 vars in 1122 bytes} [Fri Oct 28 19:01:05 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:01:05.644828 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66f593e-2b24-42b4-b91d-83a8575edbf1 admin admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:01:05.655207 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66f593e-2b24-42b4-b91d-83a8575edbf1 admin admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:01:05.659983 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d34502-8a3a-4fed-a302-d9af8eda927a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b7477232f9249b8beb26277f784d073', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:01:05.660831 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d34502-8a3a-4fed-a302-d9af8eda927a admin admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:01:05.661302 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d34502-8a3a-4fed-a302-d9af8eda927a admin admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:01:05.661832 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d34502-8a3a-4fed-a302-d9af8eda927a admin admin] PATH_INFO: `/v3/groups/b9cd1ff07b954a08860e9a9837c816b3` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:01:05.663153 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d34502-8a3a-4fed-a302-d9af8eda927a admin admin] RBAC: Authorizing `identity:get_group(group_id=b9cd1ff07b954a08860e9a9837c816b3)` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:01:05.664381 dv-cinder-862365-1-smb devstack@keystone.service[81765]: WARNING py.warnings [None req-f9d34502-8a3a-4fed-a302-d9af8eda927a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_group": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 28 19:01:05.664381 dv-cinder-862365-1-smb devstack@keystone.service[81765]: warnings.warn(msg) Oct 28 19:01:05.664381 dv-cinder-862365-1-smb devstack@keystone.service[81765]: Oct 28 19:01:05.666172 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d34502-8a3a-4fed-a302-d9af8eda927a admin admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:01:05.669060 dv-cinder-862365-1-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 142/279] 10.222.0.23 () {56 vars in 1201 bytes} [Fri Oct 28 19:01:05 2022] GET /identity/v3/groups/b9cd1ff07b954a08860e9a9837c816b3 => generated 226 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 19:01:05.675275 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d34502-8a3a-4fed-a302-d9af8eda927a admin admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:01:05.676990 dv-cinder-862365-1-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 138/280] 10.222.0.23 () {58 vars in 1463 bytes} [Fri Oct 28 19:01:05 2022] PUT /identity/v3/projects/575e6206099b4a24bc9b829f3e7b6bdc/groups/b9cd1ff07b954a08860e9a9837c816b3/roles/a11a1b300fe044b5a905284bc623dc41 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 19:01:05.687414 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d34502-8a3a-4fed-a302-d9af8eda927a admin admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:01:05.761249 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d42d39-91ea-4338-8490-20c4a5019ea0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b7477232f9249b8beb26277f784d073', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:01:05.762958 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d42d39-91ea-4338-8490-20c4a5019ea0 admin admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:01:05.763559 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d42d39-91ea-4338-8490-20c4a5019ea0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:01:05.764028 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d42d39-91ea-4338-8490-20c4a5019ea0 admin admin] PATH_INFO: `/v3/projects/0e59baa74fa1427ab5e2f47d5fb1e4c7` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:01:05.765558 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d42d39-91ea-4338-8490-20c4a5019ea0 admin admin] RBAC: Authorizing `identity:get_project(project_id=0e59baa74fa1427ab5e2f47d5fb1e4c7)` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:01:05.768008 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d42d39-91ea-4338-8490-20c4a5019ea0 admin admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:01:05.771599 dv-cinder-862365-1-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 143/281] 10.222.0.23 () {56 vars in 1207 bytes} [Fri Oct 28 19:01:05 2022] GET /identity/v3/projects/0e59baa74fa1427ab5e2f47d5fb1e4c7 => generated 302 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:01:05.777814 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4707622e-a3e6-44a1-bf72-147b28aa607d admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:01:05.788725 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4707622e-a3e6-44a1-bf72-147b28aa607d admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:01:05.795945 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409be2c0-b2e9-40d7-90cf-9bc6cb589bbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b7477232f9249b8beb26277f784d073', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:01:05.798366 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409be2c0-b2e9-40d7-90cf-9bc6cb589bbe admin admin] REQUEST_METHOD: `PUT` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:01:05.798366 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409be2c0-b2e9-40d7-90cf-9bc6cb589bbe admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:01:05.798366 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409be2c0-b2e9-40d7-90cf-9bc6cb589bbe admin admin] PATH_INFO: `/v3/projects/0e59baa74fa1427ab5e2f47d5fb1e4c7/groups/b9cd1ff07b954a08860e9a9837c816b3/roles/c193f661c7504bdf80c036f745eba59b` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:01:05.800177 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409be2c0-b2e9-40d7-90cf-9bc6cb589bbe admin admin] RBAC: Authorizing `identity:create_grant(project_id=0e59baa74fa1427ab5e2f47d5fb1e4c7, group_id=b9cd1ff07b954a08860e9a9837c816b3, role_id=c193f661c7504bdf80c036f745eba59b)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:01:05.802906 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409be2c0-b2e9-40d7-90cf-9bc6cb589bbe admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:01:05.907036 dv-cinder-862365-1-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 139/282] 10.222.0.23 () {58 vars in 1463 bytes} [Fri Oct 28 19:01:05 2022] PUT /identity/v3/projects/0e59baa74fa1427ab5e2f47d5fb1e4c7/groups/b9cd1ff07b954a08860e9a9837c816b3/roles/c193f661c7504bdf80c036f745eba59b => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 19:01:06.146277 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76024e7-1288-4023-8819-bb2f76b54cc8 None None] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:01:06.146946 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76024e7-1288-4023-8819-bb2f76b54cc8 None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:01:06.147423 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76024e7-1288-4023-8819-bb2f76b54cc8 None None] PATH_INFO: `/` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:01:06.149213 dv-cinder-862365-1-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 144/283] 10.222.0.23 () {54 vars in 927 bytes} [Fri Oct 28 19:01:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 19:01:06.155974 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9374e3c-493f-4d80-a97e-043d4d44b271 None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:01:06.156314 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9374e3c-493f-4d80-a97e-043d4d44b271 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:01:06.156528 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9374e3c-493f-4d80-a97e-043d4d44b271 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:01:06.177134 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-e9374e3c-493f-4d80-a97e-043d4d44b271 None None] MFA Rules not processed for user `ae863915635746d1ac19970949de4722`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:01:06.178279 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-e9374e3c-493f-4d80-a97e-043d4d44b271 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:01:06.253033 dv-cinder-862365-1-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 140/284] 10.222.0.23 () {58 vars in 1024 bytes} [Fri Oct 28 19:01:06 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Oct 28 19:01:06.625527 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76024e7-1288-4023-8819-bb2f76b54cc8 None None] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:01:06.641779 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76024e7-1288-4023-8819-bb2f76b54cc8 None None] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:01:06.646427 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7388bf1d-1ee4-4d03-9558-67f52e8f0930 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b7477232f9249b8beb26277f784d073', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:01:06.647066 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7388bf1d-1ee4-4d03-9558-67f52e8f0930 admin admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:01:06.647346 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7388bf1d-1ee4-4d03-9558-67f52e8f0930 admin admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:01:06.647621 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7388bf1d-1ee4-4d03-9558-67f52e8f0930 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:01:06.660309 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7388bf1d-1ee4-4d03-9558-67f52e8f0930 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 19:01:06.665605 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application [None req-7388bf1d-1ee4-4d03-9558-67f52e8f0930 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 28 19:01:06.665605 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 19:01:06.665605 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 19:01:06.665605 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 19:01:06.665605 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 19:01:06.665605 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 19:01:06.665605 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 19:01:06.665605 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 19:01:06.665605 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 19:01:06.665605 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 19:01:06.665605 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 19:01:06.665605 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 19:01:06.665605 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 28 19:01:06.665605 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 28 19:01:06.665605 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 28 19:01:06.665605 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 28 19:01:06.666501 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 28 19:01:06.666501 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 28 19:01:06.666501 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 28 19:01:06.666501 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 28 19:01:06.666501 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 19:01:06.666501 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 19:01:06.666501 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 19:01:06.666501 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 19:01:06.666501 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 19:01:06.666501 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 19:01:06.666501 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 19:01:06.666501 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application with Lock( Oct 28 19:01:06.666501 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 19:01:06.666501 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._enter() Oct 28 19:01:06.666501 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 19:01:06.666501 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 19:01:06.668454 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 19:01:06.668454 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.creator() Oct 28 19:01:06.668454 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 19:01:06.668454 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application created_value = creator( Oct 28 19:01:06.668454 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 28 19:01:06.668454 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 28 19:01:06.668454 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 28 19:01:06.668454 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 28 19:01:06.668454 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 28 19:01:06.668454 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 28 19:01:06.668454 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 28 19:01:06.668454 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application Oct 28 19:01:06.668454 dv-cinder-862365-1-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 145/285] 10.222.0.23 () {56 vars in 1135 bytes} [Fri Oct 28 19:01:06 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 19:01:06.673095 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9374e3c-493f-4d80-a97e-043d4d44b271 None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:01:06.687094 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9374e3c-493f-4d80-a97e-043d4d44b271 None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:01:06.697921 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec9c8e4-5532-47dc-9e72-adc2dec4600b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b7477232f9249b8beb26277f784d073', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:01:06.698962 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec9c8e4-5532-47dc-9e72-adc2dec4600b admin admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:01:06.699464 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec9c8e4-5532-47dc-9e72-adc2dec4600b admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:01:06.699935 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec9c8e4-5532-47dc-9e72-adc2dec4600b admin admin] PATH_INFO: `/v3/roles` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:01:06.700808 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec9c8e4-5532-47dc-9e72-adc2dec4600b admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:01:06.701321 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec9c8e4-5532-47dc-9e72-adc2dec4600b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:01:06.703211 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec9c8e4-5532-47dc-9e72-adc2dec4600b admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:01:06.718683 dv-cinder-862365-1-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 141/286] 10.222.0.23 () {56 vars in 1132 bytes} [Fri Oct 28 19:01:06 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:01:06.724235 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7388bf1d-1ee4-4d03-9558-67f52e8f0930 admin admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:01:06.739821 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7388bf1d-1ee4-4d03-9558-67f52e8f0930 admin admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:01:06.749078 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb697aa-ce57-4d98-ad66-b0258c7cb67d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b7477232f9249b8beb26277f784d073', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:01:06.749749 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb697aa-ce57-4d98-ad66-b0258c7cb67d admin admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:01:06.750037 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb697aa-ce57-4d98-ad66-b0258c7cb67d admin admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:01:06.750311 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb697aa-ce57-4d98-ad66-b0258c7cb67d admin admin] PATH_INFO: `/v3/groups/b9cd1ff07b954a08860e9a9837c816b3` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:01:06.751437 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb697aa-ce57-4d98-ad66-b0258c7cb67d admin admin] RBAC: Authorizing `identity:get_group(group_id=b9cd1ff07b954a08860e9a9837c816b3)` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:01:06.753371 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb697aa-ce57-4d98-ad66-b0258c7cb67d admin admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:01:06.755181 dv-cinder-862365-1-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 146/287] 10.222.0.23 () {56 vars in 1201 bytes} [Fri Oct 28 19:01:06 2022] GET /identity/v3/groups/b9cd1ff07b954a08860e9a9837c816b3 => generated 226 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:01:06.760343 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec9c8e4-5532-47dc-9e72-adc2dec4600b admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:01:06.778172 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec9c8e4-5532-47dc-9e72-adc2dec4600b admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:01:06.783101 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec779eb-0387-4285-aecf-465f84452580 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b7477232f9249b8beb26277f784d073', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:01:06.783974 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec779eb-0387-4285-aecf-465f84452580 admin admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:01:06.784477 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec779eb-0387-4285-aecf-465f84452580 admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:01:06.785050 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec779eb-0387-4285-aecf-465f84452580 admin admin] PATH_INFO: `/v3/projects/0e59baa74fa1427ab5e2f47d5fb1e4c7` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:01:06.787447 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec779eb-0387-4285-aecf-465f84452580 admin admin] RBAC: Authorizing `identity:get_project(project_id=0e59baa74fa1427ab5e2f47d5fb1e4c7)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:01:06.789841 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec779eb-0387-4285-aecf-465f84452580 admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:01:06.791703 dv-cinder-862365-1-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 142/288] 10.222.0.23 () {56 vars in 1207 bytes} [Fri Oct 28 19:01:06 2022] GET /identity/v3/projects/0e59baa74fa1427ab5e2f47d5fb1e4c7 => generated 302 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:01:06.797826 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb697aa-ce57-4d98-ad66-b0258c7cb67d admin admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:01:06.808730 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb697aa-ce57-4d98-ad66-b0258c7cb67d admin admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:01:06.817529 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0397dd49-3c6f-41ef-ad43-6359b2b29f38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b7477232f9249b8beb26277f784d073', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:01:06.818438 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0397dd49-3c6f-41ef-ad43-6359b2b29f38 admin admin] REQUEST_METHOD: `PUT` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:01:06.818644 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0397dd49-3c6f-41ef-ad43-6359b2b29f38 admin admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:01:06.818905 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0397dd49-3c6f-41ef-ad43-6359b2b29f38 admin admin] PATH_INFO: `/v3/projects/0e59baa74fa1427ab5e2f47d5fb1e4c7/groups/b9cd1ff07b954a08860e9a9837c816b3/roles/a11a1b300fe044b5a905284bc623dc41` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:01:06.820473 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97948600-51c5-4f2b-8335-7c59c10987f8 None None] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:01:06.820945 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97948600-51c5-4f2b-8335-7c59c10987f8 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:01:06.821213 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97948600-51c5-4f2b-8335-7c59c10987f8 None None] PATH_INFO: `/` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:01:06.822714 dv-cinder-862365-1-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 143/289] 10.222.0.23 () {54 vars in 927 bytes} [Fri Oct 28 19:01:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 19:01:06.825952 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0397dd49-3c6f-41ef-ad43-6359b2b29f38 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0e59baa74fa1427ab5e2f47d5fb1e4c7, group_id=b9cd1ff07b954a08860e9a9837c816b3, role_id=a11a1b300fe044b5a905284bc623dc41)` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:01:06.827005 dv-cinder-862365-1-smb devstack@keystone.service[81765]: WARNING py.warnings [None req-0397dd49-3c6f-41ef-ad43-6359b2b29f38 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 28 19:01:06.827005 dv-cinder-862365-1-smb devstack@keystone.service[81765]: warnings.warn(msg) Oct 28 19:01:06.827005 dv-cinder-862365-1-smb devstack@keystone.service[81765]: Oct 28 19:01:06.830435 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0397dd49-3c6f-41ef-ad43-6359b2b29f38 admin admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:01:06.836147 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84306a8-6117-459f-ad74-12fd79d20d57 None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:01:06.842201 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84306a8-6117-459f-ad74-12fd79d20d57 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:01:06.842201 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84306a8-6117-459f-ad74-12fd79d20d57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:01:06.862141 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-b84306a8-6117-459f-ad74-12fd79d20d57 None None] MFA Rules not processed for user `ae863915635746d1ac19970949de4722`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:01:06.863787 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-b84306a8-6117-459f-ad74-12fd79d20d57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:01:06.873012 dv-cinder-862365-1-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 144/290] 10.222.0.23 () {58 vars in 1024 bytes} [Fri Oct 28 19:01:06 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Oct 28 19:01:06.911759 dv-cinder-862365-1-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 147/291] 10.222.0.23 () {58 vars in 1463 bytes} [Fri Oct 28 19:01:06 2022] PUT /identity/v3/projects/0e59baa74fa1427ab5e2f47d5fb1e4c7/groups/b9cd1ff07b954a08860e9a9837c816b3/roles/a11a1b300fe044b5a905284bc623dc41 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 19:01:07.201260 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84306a8-6117-459f-ad74-12fd79d20d57 None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:01:07.207288 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:01:07.212451 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84306a8-6117-459f-ad74-12fd79d20d57 None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:01:07.276201 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194d09ca-1ebb-4663-a331-71b8cb40ff6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b7477232f9249b8beb26277f784d073', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:01:07.277271 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194d09ca-1ebb-4663-a331-71b8cb40ff6b admin admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:01:07.277782 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194d09ca-1ebb-4663-a331-71b8cb40ff6b admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:01:07.278253 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194d09ca-1ebb-4663-a331-71b8cb40ff6b admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:01:07.291510 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194d09ca-1ebb-4663-a331-71b8cb40ff6b admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 19:01:07.296994 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application [None req-194d09ca-1ebb-4663-a331-71b8cb40ff6b admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 28 19:01:07.296994 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 19:01:07.296994 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 19:01:07.296994 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 19:01:07.296994 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 19:01:07.296994 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 19:01:07.296994 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 19:01:07.296994 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 19:01:07.296994 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 19:01:07.296994 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 19:01:07.296994 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 19:01:07.296994 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 19:01:07.296994 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 28 19:01:07.296994 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 28 19:01:07.296994 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 28 19:01:07.296994 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 28 19:01:07.297892 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 28 19:01:07.297892 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 28 19:01:07.297892 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 28 19:01:07.297892 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 28 19:01:07.297892 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 19:01:07.297892 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 19:01:07.297892 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 19:01:07.297892 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 19:01:07.297892 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 19:01:07.297892 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 19:01:07.297892 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 19:01:07.297892 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application with Lock( Oct 28 19:01:07.297892 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 19:01:07.297892 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._enter() Oct 28 19:01:07.297892 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 19:01:07.297892 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 19:01:07.298690 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 19:01:07.298690 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.creator() Oct 28 19:01:07.298690 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 19:01:07.298690 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application created_value = creator( Oct 28 19:01:07.298690 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 28 19:01:07.298690 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 28 19:01:07.298690 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 28 19:01:07.298690 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 28 19:01:07.298690 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 28 19:01:07.298690 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 28 19:01:07.298690 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 28 19:01:07.298690 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Oct 28 19:01:07.301234 dv-cinder-862365-1-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 145/292] 10.222.0.23 () {56 vars in 1117 bytes} [Fri Oct 28 19:01:07 2022] GET /identity/v3/roles/admin => generated 83 bytes in 100 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 19:01:07.307222 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0397dd49-3c6f-41ef-ad43-6359b2b29f38 admin admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:01:07.319163 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:01:07.323024 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0397dd49-3c6f-41ef-ad43-6359b2b29f38 admin admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:01:07.329077 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17bc2a4f-ee65-49f1-be3e-46c5b1724f71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b7477232f9249b8beb26277f784d073', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:01:07.329712 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bc2a4f-ee65-49f1-be3e-46c5b1724f71 admin admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:01:07.329994 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bc2a4f-ee65-49f1-be3e-46c5b1724f71 admin admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:01:07.330331 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bc2a4f-ee65-49f1-be3e-46c5b1724f71 admin admin] PATH_INFO: `/v3/roles` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:01:07.331053 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17bc2a4f-ee65-49f1-be3e-46c5b1724f71 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=81765) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:01:07.334629 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17bc2a4f-ee65-49f1-be3e-46c5b1724f71 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:01:07.334629 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17bc2a4f-ee65-49f1-be3e-46c5b1724f71 admin admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:01:07.344427 dv-cinder-862365-1-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 148/293] 10.222.0.23 () {56 vars in 1120 bytes} [Fri Oct 28 19:01:07 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:01:07.350106 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194d09ca-1ebb-4663-a331-71b8cb40ff6b admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:01:07.364738 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194d09ca-1ebb-4663-a331-71b8cb40ff6b admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:01:07.369316 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841691ff-d655-4d5c-bfb6-af08ebfd0b78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b7477232f9249b8beb26277f784d073', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:01:07.370576 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841691ff-d655-4d5c-bfb6-af08ebfd0b78 admin admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:01:07.370907 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841691ff-d655-4d5c-bfb6-af08ebfd0b78 admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:01:07.371185 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841691ff-d655-4d5c-bfb6-af08ebfd0b78 admin admin] PATH_INFO: `/v3/groups/04ce5014e7564e4c99f6375062b24cd3` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:01:07.379602 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841691ff-d655-4d5c-bfb6-af08ebfd0b78 admin admin] RBAC: Authorizing `identity:get_group(group_id=04ce5014e7564e4c99f6375062b24cd3)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:01:07.381613 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841691ff-d655-4d5c-bfb6-af08ebfd0b78 admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:01:07.383493 dv-cinder-862365-1-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 146/294] 10.222.0.23 () {56 vars in 1201 bytes} [Fri Oct 28 19:01:07 2022] GET /identity/v3/groups/04ce5014e7564e4c99f6375062b24cd3 => generated 229 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:01:07.389621 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17bc2a4f-ee65-49f1-be3e-46c5b1724f71 admin admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:01:07.401917 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17bc2a4f-ee65-49f1-be3e-46c5b1724f71 admin admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:01:07.406575 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6959fee-fdef-407f-b8f9-6b3368cf4432 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b7477232f9249b8beb26277f784d073', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:01:07.407213 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6959fee-fdef-407f-b8f9-6b3368cf4432 admin admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:01:07.407543 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6959fee-fdef-407f-b8f9-6b3368cf4432 admin admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:01:07.407824 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6959fee-fdef-407f-b8f9-6b3368cf4432 admin admin] PATH_INFO: `/v3/projects/5b7477232f9249b8beb26277f784d073` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:01:07.408958 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6959fee-fdef-407f-b8f9-6b3368cf4432 admin admin] RBAC: Authorizing `identity:get_project(project_id=5b7477232f9249b8beb26277f784d073)` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:01:07.410833 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6959fee-fdef-407f-b8f9-6b3368cf4432 admin admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:01:07.412587 dv-cinder-862365-1-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 149/295] 10.222.0.23 () {56 vars in 1207 bytes} [Fri Oct 28 19:01:07 2022] GET /identity/v3/projects/5b7477232f9249b8beb26277f784d073 => generated 344 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:01:07.418456 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841691ff-d655-4d5c-bfb6-af08ebfd0b78 admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:01:07.428647 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841691ff-d655-4d5c-bfb6-af08ebfd0b78 admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:01:07.433986 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c409709-abe6-4973-b275-8b87605ce37b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b7477232f9249b8beb26277f784d073', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:01:07.434651 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c409709-abe6-4973-b275-8b87605ce37b admin admin] REQUEST_METHOD: `PUT` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:01:07.434930 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c409709-abe6-4973-b275-8b87605ce37b admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:01:07.435207 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c409709-abe6-4973-b275-8b87605ce37b admin admin] PATH_INFO: `/v3/projects/5b7477232f9249b8beb26277f784d073/groups/04ce5014e7564e4c99f6375062b24cd3/roles/a9e4e47c2bf448fcbada91c1174644f7` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:01:07.437269 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c409709-abe6-4973-b275-8b87605ce37b admin admin] RBAC: Authorizing `identity:create_grant(project_id=5b7477232f9249b8beb26277f784d073, group_id=04ce5014e7564e4c99f6375062b24cd3, role_id=a9e4e47c2bf448fcbada91c1174644f7)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:01:07.440070 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c409709-abe6-4973-b275-8b87605ce37b admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:01:07.525005 dv-cinder-862365-1-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 147/296] 10.222.0.23 () {58 vars in 1463 bytes} [Fri Oct 28 19:01:07 2022] PUT /identity/v3/projects/5b7477232f9249b8beb26277f784d073/groups/04ce5014e7564e4c99f6375062b24cd3/roles/a9e4e47c2bf448fcbada91c1174644f7 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 19:01:07.706728 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9253d243-b340-47af-8d2f-c5997226e13d None None] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:01:07.707073 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9253d243-b340-47af-8d2f-c5997226e13d None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:01:07.707282 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9253d243-b340-47af-8d2f-c5997226e13d None None] PATH_INFO: `/` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:01:07.708660 dv-cinder-862365-1-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 150/297] 10.222.0.23 () {54 vars in 927 bytes} [Fri Oct 28 19:01:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 19:01:07.714863 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c879309d-db9c-4b05-9f42-887681b51d2c None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:01:07.715150 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c879309d-db9c-4b05-9f42-887681b51d2c None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:01:07.715429 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c879309d-db9c-4b05-9f42-887681b51d2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:01:07.736549 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-c879309d-db9c-4b05-9f42-887681b51d2c None None] MFA Rules not processed for user `ae863915635746d1ac19970949de4722`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:01:07.737812 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-c879309d-db9c-4b05-9f42-887681b51d2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:01:07.837248 dv-cinder-862365-1-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 148/298] 10.222.0.23 () {58 vars in 1024 bytes} [Fri Oct 28 19:01:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 28 19:01:08.147489 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9253d243-b340-47af-8d2f-c5997226e13d None None] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:01:08.271117 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9253d243-b340-47af-8d2f-c5997226e13d None None] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:01:08.317477 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1d8b48-863a-470f-b387-39146bee0bd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:01:08.318147 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1d8b48-863a-470f-b387-39146bee0bd1 None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:01:08.318432 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1d8b48-863a-470f-b387-39146bee0bd1 None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:01:08.318710 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1d8b48-863a-470f-b387-39146bee0bd1 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:01:08.334933 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d1d8b48-863a-470f-b387-39146bee0bd1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 19:01:08.341609 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application [None req-6d1d8b48-863a-470f-b387-39146bee0bd1 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 28 19:01:08.341609 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 19:01:08.341609 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 19:01:08.341609 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 19:01:08.341609 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 19:01:08.341609 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 19:01:08.341609 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 19:01:08.341609 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 19:01:08.341609 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 19:01:08.341609 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 19:01:08.341609 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 19:01:08.341609 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 19:01:08.341609 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 28 19:01:08.341609 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 28 19:01:08.341609 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 28 19:01:08.341609 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 28 19:01:08.342551 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 28 19:01:08.342551 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 28 19:01:08.342551 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 28 19:01:08.342551 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 28 19:01:08.342551 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 19:01:08.342551 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 19:01:08.342551 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 19:01:08.342551 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 19:01:08.342551 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 19:01:08.342551 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 19:01:08.342551 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 19:01:08.342551 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application with Lock( Oct 28 19:01:08.342551 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 19:01:08.342551 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._enter() Oct 28 19:01:08.342551 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 19:01:08.342551 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 19:01:08.343362 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 19:01:08.343362 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.creator() Oct 28 19:01:08.343362 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 19:01:08.343362 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application created_value = creator( Oct 28 19:01:08.343362 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 28 19:01:08.343362 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 28 19:01:08.343362 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 28 19:01:08.343362 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 28 19:01:08.343362 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 28 19:01:08.343362 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 28 19:01:08.343362 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 28 19:01:08.343362 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application Oct 28 19:01:08.343362 dv-cinder-862365-1-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 151/299] 10.222.0.23 () {56 vars in 1099 bytes} [Fri Oct 28 19:01:08 2022] GET /identity/v3/roles/member => generated 84 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 19:01:08.348665 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c879309d-db9c-4b05-9f42-887681b51d2c None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:01:08.430088 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:01:08.452672 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf7ae43-38a2-4c91-ab55-d467eef6ef55 None None] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:01:08.453026 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf7ae43-38a2-4c91-ab55-d467eef6ef55 None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:01:08.453314 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf7ae43-38a2-4c91-ab55-d467eef6ef55 None None] PATH_INFO: `/` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:01:08.456261 dv-cinder-862365-1-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 152/300] 10.222.0.23 () {54 vars in 927 bytes} [Fri Oct 28 19:01:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 28 19:01:08.482518 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febd8ff8-1eef-4471-9b8a-1a0eaccb9baf None None] REQUEST_METHOD: `POST` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:01:08.482800 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febd8ff8-1eef-4471-9b8a-1a0eaccb9baf None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:01:08.483141 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febd8ff8-1eef-4471-9b8a-1a0eaccb9baf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:01:08.491281 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c879309d-db9c-4b05-9f42-887681b51d2c None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:01:08.515658 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.auth.core [None req-febd8ff8-1eef-4471-9b8a-1a0eaccb9baf None None] MFA Rules not processed for user `ae863915635746d1ac19970949de4722`. Rule list: `[]` (Enabled: `True`). {{(pid=81765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:01:08.516589 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-febd8ff8-1eef-4471-9b8a-1a0eaccb9baf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:01:08.539440 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ab5fb0-761e-4669-b9da-9b7632ab3897 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:01:08.540441 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ab5fb0-761e-4669-b9da-9b7632ab3897 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:01:08.540945 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ab5fb0-761e-4669-b9da-9b7632ab3897 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:01:08.541437 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ab5fb0-761e-4669-b9da-9b7632ab3897 None admin] PATH_INFO: `/v3/roles` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:01:08.542867 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ab5fb0-761e-4669-b9da-9b7632ab3897 None admin] RBAC: Adding query filter params (name=member) {{(pid=81766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:01:08.545072 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ab5fb0-761e-4669-b9da-9b7632ab3897 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:01:08.546775 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ab5fb0-761e-4669-b9da-9b7632ab3897 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:01:08.568682 dv-cinder-862365-1-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 149/301] 10.222.0.23 () {56 vars in 1101 bytes} [Fri Oct 28 19:01:08 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:01:08.586364 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ab5fb0-761e-4669-b9da-9b7632ab3897 None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:01:08.628479 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:01:08.664107 dv-cinder-862365-1-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 153/302] 10.222.0.23 () {58 vars in 1024 bytes} [Fri Oct 28 19:01:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 28 19:01:08.755052 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ab5fb0-761e-4669-b9da-9b7632ab3897 None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:01:08.779067 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:01:08.806935 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8435dcc9-006e-4795-bea5-b3d070da6cb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:01:08.807591 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8435dcc9-006e-4795-bea5-b3d070da6cb2 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:01:08.807874 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8435dcc9-006e-4795-bea5-b3d070da6cb2 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:01:08.808148 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8435dcc9-006e-4795-bea5-b3d070da6cb2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:01:08.917431 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8435dcc9-006e-4795-bea5-b3d070da6cb2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:01:08.918905 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8435dcc9-006e-4795-bea5-b3d070da6cb2 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:01:09.003723 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febd8ff8-1eef-4471-9b8a-1a0eaccb9baf None None] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:01:09.072184 dv-cinder-862365-1-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 150/303] 10.222.0.23 () {58 vars in 1282 bytes} [Fri Oct 28 19:01:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 487 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Oct 28 19:01:09.078473 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1ab0a9-8ae3-4a3d-a5e7-c6306c059246 None None] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:01:09.079057 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1ab0a9-8ae3-4a3d-a5e7-c6306c059246 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:01:09.079568 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1ab0a9-8ae3-4a3d-a5e7-c6306c059246 None None] PATH_INFO: `/` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:01:09.081867 dv-cinder-862365-1-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 151/304] 10.222.0.23 () {54 vars in 927 bytes} [Fri Oct 28 19:01:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 19:01:09.083186 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1ab0a9-8ae3-4a3d-a5e7-c6306c059246 None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:01:09.108055 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:01:09.164670 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febd8ff8-1eef-4471-9b8a-1a0eaccb9baf None None] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:01:09.202913 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d436d8cf-42c6-40d2-8011-551a552abaa9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:01:09.203902 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d436d8cf-42c6-40d2-8011-551a552abaa9 None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:01:09.204380 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d436d8cf-42c6-40d2-8011-551a552abaa9 None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:01:09.204862 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d436d8cf-42c6-40d2-8011-551a552abaa9 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:01:09.216632 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1ab0a9-8ae3-4a3d-a5e7-c6306c059246 None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:01:09.219298 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d436d8cf-42c6-40d2-8011-551a552abaa9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 19:01:09.224457 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application [None req-d436d8cf-42c6-40d2-8011-551a552abaa9 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 28 19:01:09.224457 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 19:01:09.224457 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 19:01:09.224457 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 19:01:09.224457 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 19:01:09.224457 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 19:01:09.224457 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 19:01:09.224457 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 19:01:09.224457 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 19:01:09.224457 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 19:01:09.224457 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 19:01:09.224457 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 19:01:09.224457 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 28 19:01:09.224457 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 28 19:01:09.224457 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 28 19:01:09.224457 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 28 19:01:09.225315 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 28 19:01:09.225315 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 28 19:01:09.225315 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 28 19:01:09.225315 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 28 19:01:09.225315 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 19:01:09.225315 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 19:01:09.225315 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 19:01:09.225315 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 19:01:09.225315 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 19:01:09.225315 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 19:01:09.225315 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 19:01:09.225315 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application with Lock( Oct 28 19:01:09.225315 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 19:01:09.225315 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._enter() Oct 28 19:01:09.225315 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 19:01:09.225315 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 19:01:09.226139 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 19:01:09.226139 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.creator() Oct 28 19:01:09.226139 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 19:01:09.226139 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application created_value = creator( Oct 28 19:01:09.226139 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 28 19:01:09.226139 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 28 19:01:09.226139 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 28 19:01:09.226139 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 28 19:01:09.226139 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 28 19:01:09.226139 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 28 19:01:09.226139 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 28 19:01:09.226139 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application Oct 28 19:01:09.235864 dv-cinder-862365-1-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 154/305] 10.222.0.23 () {56 vars in 1099 bytes} [Fri Oct 28 19:01:09 2022] GET /identity/v3/roles/member => generated 84 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 19:01:09.237434 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8171a510-b459-4d12-9cb3-30b2aa4c6e59 None None] REQUEST_METHOD: `POST` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:01:09.237934 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8171a510-b459-4d12-9cb3-30b2aa4c6e59 None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:01:09.238399 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8171a510-b459-4d12-9cb3-30b2aa4c6e59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:01:09.253777 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f690a70a-3ab2-4d56-aa9d-7dbf539af98c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:01:09.254412 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f690a70a-3ab2-4d56-aa9d-7dbf539af98c None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:01:09.254699 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f690a70a-3ab2-4d56-aa9d-7dbf539af98c None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:01:09.254974 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f690a70a-3ab2-4d56-aa9d-7dbf539af98c None admin] PATH_INFO: `/v3/projects/575e6206099b4a24bc9b829f3e7b6bdc` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:01:09.256106 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f690a70a-3ab2-4d56-aa9d-7dbf539af98c None admin] RBAC: Authorizing `identity:get_project(project_id=575e6206099b4a24bc9b829f3e7b6bdc)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:01:09.257675 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f690a70a-3ab2-4d56-aa9d-7dbf539af98c None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:01:09.258646 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.auth.core [None req-8171a510-b459-4d12-9cb3-30b2aa4c6e59 None None] MFA Rules not processed for user `ae863915635746d1ac19970949de4722`. Rule list: `[]` (Enabled: `True`). {{(pid=81765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:01:09.259315 dv-cinder-862365-1-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 152/306] 10.222.0.23 () {56 vars in 1186 bytes} [Fri Oct 28 19:01:09 2022] GET /identity/v3/projects/575e6206099b4a24bc9b829f3e7b6bdc => generated 298 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:01:09.260068 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f690a70a-3ab2-4d56-aa9d-7dbf539af98c None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:01:09.261176 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-8171a510-b459-4d12-9cb3-30b2aa4c6e59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:01:09.298767 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:01:09.334090 dv-cinder-862365-1-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 155/307] 10.222.0.23 () {58 vars in 1024 bytes} [Fri Oct 28 19:01:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 28 19:01:09.335338 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8171a510-b459-4d12-9cb3-30b2aa4c6e59 None None] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:01:09.354325 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:01:09.371896 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f690a70a-3ab2-4d56-aa9d-7dbf539af98c None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:01:09.419091 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94b8ae3-d036-45fa-8a7e-3f3b8bb2a63a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:01:09.419953 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94b8ae3-d036-45fa-8a7e-3f3b8bb2a63a None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:01:09.420373 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94b8ae3-d036-45fa-8a7e-3f3b8bb2a63a None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:01:09.420779 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94b8ae3-d036-45fa-8a7e-3f3b8bb2a63a None admin] PATH_INFO: `/v3/roles` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:01:09.421650 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94b8ae3-d036-45fa-8a7e-3f3b8bb2a63a None admin] RBAC: Adding query filter params (name=member) {{(pid=81766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:01:09.422097 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94b8ae3-d036-45fa-8a7e-3f3b8bb2a63a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:01:09.423605 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94b8ae3-d036-45fa-8a7e-3f3b8bb2a63a None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:01:09.432542 dv-cinder-862365-1-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 153/308] 10.222.0.23 () {56 vars in 1101 bytes} [Fri Oct 28 19:01:09 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:01:09.452082 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8171a510-b459-4d12-9cb3-30b2aa4c6e59 None None] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:01:09.454795 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94b8ae3-d036-45fa-8a7e-3f3b8bb2a63a None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:01:09.493377 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d195f6e3-00ed-499f-8f26-67546c2ee336 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:01:09.493377 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d195f6e3-00ed-499f-8f26-67546c2ee336 None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:01:09.493377 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d195f6e3-00ed-499f-8f26-67546c2ee336 None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:01:09.493377 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d195f6e3-00ed-499f-8f26-67546c2ee336 None admin] PATH_INFO: `/v3/groups/b9cd1ff07b954a08860e9a9837c816b3` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:01:09.495370 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d195f6e3-00ed-499f-8f26-67546c2ee336 None admin] RBAC: Authorizing `identity:get_group(group_id=b9cd1ff07b954a08860e9a9837c816b3)` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:01:09.497058 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d195f6e3-00ed-499f-8f26-67546c2ee336 None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:01:09.501903 dv-cinder-862365-1-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 156/309] 10.222.0.23 () {56 vars in 1180 bytes} [Fri Oct 28 19:01:09 2022] GET /identity/v3/groups/b9cd1ff07b954a08860e9a9837c816b3 => generated 226 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:01:09.505879 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d195f6e3-00ed-499f-8f26-67546c2ee336 None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:01:09.577247 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:01:09.649500 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d195f6e3-00ed-499f-8f26-67546c2ee336 None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:01:09.686119 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22a959e-d7fc-409f-9507-37177d7b50f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:01:09.686736 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22a959e-d7fc-409f-9507-37177d7b50f2 None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:01:09.687017 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22a959e-d7fc-409f-9507-37177d7b50f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:01:09.687288 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22a959e-d7fc-409f-9507-37177d7b50f2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:01:09.688017 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d22a959e-d7fc-409f-9507-37177d7b50f2 None admin] RBAC: Adding query filter params (group.id=b9cd1ff07b954a08860e9a9837c816b3, role.id=c193f661c7504bdf80c036f745eba59b, scope.project.id=575e6206099b4a24bc9b829f3e7b6bdc) {{(pid=81765) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:01:09.688318 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d22a959e-d7fc-409f-9507-37177d7b50f2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:01:09.689760 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d22a959e-d7fc-409f-9507-37177d7b50f2 None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:01:09.696105 dv-cinder-862365-1-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 157/310] 10.222.0.23 () {56 vars in 1376 bytes} [Fri Oct 28 19:01:09 2022] GET /identity/v3/role_assignments?group.id=b9cd1ff07b954a08860e9a9837c816b3&scope.project.id=575e6206099b4a24bc9b829f3e7b6bdc&role.id=c193f661c7504bdf80c036f745eba59b => generated 611 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:01:09.701839 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94b8ae3-d036-45fa-8a7e-3f3b8bb2a63a None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:01:09.717166 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22a959e-d7fc-409f-9507-37177d7b50f2 None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:01:09.769035 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b0ef14-1109-4aca-80f5-0d369b2f6609 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:01:09.769775 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b0ef14-1109-4aca-80f5-0d369b2f6609 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:01:09.770066 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b0ef14-1109-4aca-80f5-0d369b2f6609 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:01:09.770339 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b0ef14-1109-4aca-80f5-0d369b2f6609 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:01:09.796943 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:01:09.836993 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22a959e-d7fc-409f-9507-37177d7b50f2 None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:01:09.879966 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:01:09.882597 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd6828b-4ac8-4e39-a648-0ed5d0ee5c97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:01:09.882982 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd6828b-4ac8-4e39-a648-0ed5d0ee5c97 None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:01:09.883337 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd6828b-4ac8-4e39-a648-0ed5d0ee5c97 None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:01:09.883616 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd6828b-4ac8-4e39-a648-0ed5d0ee5c97 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:01:09.900051 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b0ef14-1109-4aca-80f5-0d369b2f6609 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:01:09.902485 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b0ef14-1109-4aca-80f5-0d369b2f6609 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:01:09.910123 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd6828b-4ac8-4e39-a648-0ed5d0ee5c97 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 19:01:09.915801 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application [None req-1dd6828b-4ac8-4e39-a648-0ed5d0ee5c97 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 28 19:01:09.915801 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 19:01:09.915801 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 19:01:09.915801 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 19:01:09.915801 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 19:01:09.915801 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 19:01:09.915801 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 19:01:09.915801 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 19:01:09.915801 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 19:01:09.915801 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 19:01:09.915801 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 19:01:09.915801 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 19:01:09.915801 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 28 19:01:09.915801 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 28 19:01:09.915801 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 28 19:01:09.915801 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 28 19:01:09.916951 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 28 19:01:09.916951 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 28 19:01:09.916951 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 28 19:01:09.916951 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 28 19:01:09.916951 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 19:01:09.916951 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 19:01:09.916951 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 19:01:09.916951 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 19:01:09.916951 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 19:01:09.916951 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 19:01:09.916951 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 19:01:09.916951 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application with Lock( Oct 28 19:01:09.916951 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 19:01:09.916951 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._enter() Oct 28 19:01:09.916951 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 19:01:09.916951 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 19:01:09.917941 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 19:01:09.917941 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.creator() Oct 28 19:01:09.917941 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 19:01:09.917941 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application created_value = creator( Oct 28 19:01:09.917941 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 28 19:01:09.917941 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 28 19:01:09.917941 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 28 19:01:09.917941 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 28 19:01:09.917941 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 28 19:01:09.917941 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 28 19:01:09.917941 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 28 19:01:09.917941 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application Oct 28 19:01:09.920308 dv-cinder-862365-1-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 158/311] 10.222.0.23 () {56 vars in 1114 bytes} [Fri Oct 28 19:01:09 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 19:01:09.925964 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd6828b-4ac8-4e39-a648-0ed5d0ee5c97 None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:01:10.041427 dv-cinder-862365-1-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 154/312] 10.222.0.23 () {58 vars in 1282 bytes} [Fri Oct 28 19:01:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 586 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Oct 28 19:01:10.048444 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b0ef14-1109-4aca-80f5-0d369b2f6609 None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:01:10.054039 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd6828b-4ac8-4e39-a648-0ed5d0ee5c97 None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:01:10.100501 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff3291d-2384-465a-831f-84b7569a4873 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:01:10.100501 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff3291d-2384-465a-831f-84b7569a4873 None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:01:10.100501 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff3291d-2384-465a-831f-84b7569a4873 None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:01:10.100501 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff3291d-2384-465a-831f-84b7569a4873 None admin] PATH_INFO: `/v3/roles` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:01:10.100906 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff3291d-2384-465a-831f-84b7569a4873 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81765) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:01:10.100906 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff3291d-2384-465a-831f-84b7569a4873 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:01:10.103217 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff3291d-2384-465a-831f-84b7569a4873 None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:01:10.104809 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:01:10.110839 dv-cinder-862365-1-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 159/313] 10.222.0.23 () {56 vars in 1111 bytes} [Fri Oct 28 19:01:09 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 19:01:10.111921 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4808d3-fa95-4630-abe0-a5a32ea3642a None None] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:01:10.112212 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4808d3-fa95-4630-abe0-a5a32ea3642a None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:01:10.112494 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4808d3-fa95-4630-abe0-a5a32ea3642a None None] PATH_INFO: `/` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:01:10.114196 dv-cinder-862365-1-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 160/314] 10.222.0.23 () {54 vars in 927 bytes} [Fri Oct 28 19:01:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 19:01:10.118283 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4808d3-fa95-4630-abe0-a5a32ea3642a None None] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:01:10.153893 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:01:10.176845 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b0ef14-1109-4aca-80f5-0d369b2f6609 None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:01:10.225291 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6590bcc7-28ee-42d2-b778-4c64df079f53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:01:10.225980 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6590bcc7-28ee-42d2-b778-4c64df079f53 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:01:10.226256 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6590bcc7-28ee-42d2-b778-4c64df079f53 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:01:10.226527 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6590bcc7-28ee-42d2-b778-4c64df079f53 None admin] PATH_INFO: `/v3/projects/0e59baa74fa1427ab5e2f47d5fb1e4c7` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:01:10.227791 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6590bcc7-28ee-42d2-b778-4c64df079f53 None admin] RBAC: Authorizing `identity:get_project(project_id=0e59baa74fa1427ab5e2f47d5fb1e4c7)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:01:10.229243 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6590bcc7-28ee-42d2-b778-4c64df079f53 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:01:10.231258 dv-cinder-862365-1-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 155/315] 10.222.0.23 () {56 vars in 1186 bytes} [Fri Oct 28 19:01:10 2022] GET /identity/v3/projects/0e59baa74fa1427ab5e2f47d5fb1e4c7 => generated 302 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:01:10.236753 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5560fb-cb3d-451e-9e91-0a49e032c05a None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:01:10.237155 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5560fb-cb3d-451e-9e91-0a49e032c05a None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:01:10.237451 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5560fb-cb3d-451e-9e91-0a49e032c05a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:01:10.247972 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4808d3-fa95-4630-abe0-a5a32ea3642a None None] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:01:10.258137 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-9b5560fb-cb3d-451e-9e91-0a49e032c05a None None] MFA Rules not processed for user `ae863915635746d1ac19970949de4722`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:01:10.259444 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-9b5560fb-cb3d-451e-9e91-0a49e032c05a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:01:10.286479 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37dce33e-85ec-4e96-9638-d28cfe9c128b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:01:10.287090 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37dce33e-85ec-4e96-9638-d28cfe9c128b None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:01:10.287376 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37dce33e-85ec-4e96-9638-d28cfe9c128b None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:01:10.287656 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37dce33e-85ec-4e96-9638-d28cfe9c128b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:01:10.338307 dv-cinder-862365-1-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 156/316] 10.222.0.23 () {58 vars in 1024 bytes} [Fri Oct 28 19:01:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 28 19:01:10.339747 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5560fb-cb3d-451e-9e91-0a49e032c05a None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:01:10.381572 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37dce33e-85ec-4e96-9638-d28cfe9c128b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:01:10.383332 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37dce33e-85ec-4e96-9638-d28cfe9c128b None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:01:10.397721 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:01:10.417149 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:01:10.469028 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5560fb-cb3d-451e-9e91-0a49e032c05a None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:01:10.507613 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10348ae1-bc63-4c67-9540-c8a9db14e56b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:01:10.508286 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10348ae1-bc63-4c67-9540-c8a9db14e56b None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:01:10.508578 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10348ae1-bc63-4c67-9540-c8a9db14e56b None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:01:10.508846 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10348ae1-bc63-4c67-9540-c8a9db14e56b None admin] PATH_INFO: `/v3/groups/b9cd1ff07b954a08860e9a9837c816b3` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:01:10.511340 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10348ae1-bc63-4c67-9540-c8a9db14e56b None admin] RBAC: Authorizing `identity:get_group(group_id=b9cd1ff07b954a08860e9a9837c816b3)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:01:10.512664 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10348ae1-bc63-4c67-9540-c8a9db14e56b None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:01:10.514507 dv-cinder-862365-1-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 157/317] 10.222.0.23 () {56 vars in 1180 bytes} [Fri Oct 28 19:01:10 2022] GET /identity/v3/groups/b9cd1ff07b954a08860e9a9837c816b3 => generated 226 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:01:10.519008 dv-cinder-862365-1-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 161/318] 10.222.0.23 () {58 vars in 1282 bytes} [Fri Oct 28 19:01:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 400 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 28 19:01:10.520234 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcaca5ba-a5ae-4335-b232-a53be9afdfe9 None None] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:01:10.520523 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcaca5ba-a5ae-4335-b232-a53be9afdfe9 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:01:10.520795 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcaca5ba-a5ae-4335-b232-a53be9afdfe9 None None] PATH_INFO: `/` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:01:10.524406 dv-cinder-862365-1-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 158/319] 10.222.0.23 () {54 vars in 927 bytes} [Fri Oct 28 19:01:10 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 19:01:10.524528 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37dce33e-85ec-4e96-9638-d28cfe9c128b None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:01:10.527426 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcaca5ba-a5ae-4335-b232-a53be9afdfe9 None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:01:10.643591 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37dce33e-85ec-4e96-9638-d28cfe9c128b None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:01:10.651935 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcaca5ba-a5ae-4335-b232-a53be9afdfe9 None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:01:10.665806 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:01:10.671324 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:01:10.686165 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8799bd3-e4b2-45f3-bfb3-eb724182e0dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:01:10.686786 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8799bd3-e4b2-45f3-bfb3-eb724182e0dd None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:01:10.687062 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8799bd3-e4b2-45f3-bfb3-eb724182e0dd None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:01:10.687339 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8799bd3-e4b2-45f3-bfb3-eb724182e0dd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:01:10.688068 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8799bd3-e4b2-45f3-bfb3-eb724182e0dd None admin] RBAC: Adding query filter params (group.id=b9cd1ff07b954a08860e9a9837c816b3, role.id=c193f661c7504bdf80c036f745eba59b, scope.project.id=0e59baa74fa1427ab5e2f47d5fb1e4c7) {{(pid=81765) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:01:10.688425 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8799bd3-e4b2-45f3-bfb3-eb724182e0dd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:01:10.689895 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1daaee-d705-4522-ba73-3b8d695b9799 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:01:10.691634 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1daaee-d705-4522-ba73-3b8d695b9799 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:01:10.691634 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1daaee-d705-4522-ba73-3b8d695b9799 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:01:10.691801 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8799bd3-e4b2-45f3-bfb3-eb724182e0dd None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:01:10.691889 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1daaee-d705-4522-ba73-3b8d695b9799 None admin] PATH_INFO: `/v3/projects/575e6206099b4a24bc9b829f3e7b6bdc` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:01:10.692316 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1daaee-d705-4522-ba73-3b8d695b9799 None admin] RBAC: Authorizing `identity:get_project(project_id=575e6206099b4a24bc9b829f3e7b6bdc)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:01:10.693793 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1daaee-d705-4522-ba73-3b8d695b9799 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:01:10.695541 dv-cinder-862365-1-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 159/320] 10.222.0.23 () {56 vars in 1186 bytes} [Fri Oct 28 19:01:10 2022] GET /identity/v3/projects/575e6206099b4a24bc9b829f3e7b6bdc => generated 298 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:01:10.696562 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d7d5bd-4cae-4ae4-ab69-bf9f3f414be3 None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:01:10.696900 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d7d5bd-4cae-4ae4-ab69-bf9f3f414be3 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:01:10.697178 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d7d5bd-4cae-4ae4-ab69-bf9f3f414be3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:01:10.699841 dv-cinder-862365-1-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 162/321] 10.222.0.23 () {56 vars in 1376 bytes} [Fri Oct 28 19:01:10 2022] GET /identity/v3/role_assignments?group.id=b9cd1ff07b954a08860e9a9837c816b3&scope.project.id=0e59baa74fa1427ab5e2f47d5fb1e4c7&role.id=c193f661c7504bdf80c036f745eba59b => generated 611 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:01:10.699841 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8799bd3-e4b2-45f3-bfb3-eb724182e0dd None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:01:10.723602 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-46d7d5bd-4cae-4ae4-ab69-bf9f3f414be3 None None] MFA Rules not processed for user `ae863915635746d1ac19970949de4722`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:01:10.723602 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-46d7d5bd-4cae-4ae4-ab69-bf9f3f414be3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:01:10.813388 dv-cinder-862365-1-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 160/322] 10.222.0.23 () {58 vars in 1024 bytes} [Fri Oct 28 19:01:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 28 19:01:10.813578 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d7d5bd-4cae-4ae4-ab69-bf9f3f414be3 None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:01:10.863932 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8799bd3-e4b2-45f3-bfb3-eb724182e0dd None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:01:10.913766 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25de2344-ccb7-4c1a-b3c2-60c48975aa2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:01:10.914411 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25de2344-ccb7-4c1a-b3c2-60c48975aa2a None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:01:10.914692 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25de2344-ccb7-4c1a-b3c2-60c48975aa2a None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:01:10.914966 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25de2344-ccb7-4c1a-b3c2-60c48975aa2a None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:01:10.925930 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25de2344-ccb7-4c1a-b3c2-60c48975aa2a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 19:01:10.931273 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application [None req-25de2344-ccb7-4c1a-b3c2-60c48975aa2a None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 28 19:01:10.931273 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 19:01:10.931273 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 19:01:10.931273 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 19:01:10.931273 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 19:01:10.931273 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 19:01:10.931273 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 19:01:10.931273 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 19:01:10.931273 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 19:01:10.931273 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 19:01:10.931273 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 19:01:10.931273 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 19:01:10.931273 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 28 19:01:10.931273 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 28 19:01:10.931273 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 28 19:01:10.931273 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 28 19:01:10.932248 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 28 19:01:10.932248 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 28 19:01:10.932248 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 28 19:01:10.932248 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 28 19:01:10.932248 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 19:01:10.932248 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 19:01:10.932248 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 19:01:10.932248 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 19:01:10.932248 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 19:01:10.932248 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 19:01:10.932248 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 19:01:10.932248 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application with Lock( Oct 28 19:01:10.932248 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 19:01:10.932248 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._enter() Oct 28 19:01:10.932248 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 19:01:10.932248 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 19:01:10.933133 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 19:01:10.933133 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.creator() Oct 28 19:01:10.933133 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 19:01:10.933133 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application created_value = creator( Oct 28 19:01:10.933133 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 28 19:01:10.933133 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 28 19:01:10.933133 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 28 19:01:10.933133 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 28 19:01:10.933133 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 28 19:01:10.933133 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 28 19:01:10.933133 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 28 19:01:10.933133 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application Oct 28 19:01:10.933133 dv-cinder-862365-1-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 163/323] 10.222.0.23 () {56 vars in 1114 bytes} [Fri Oct 28 19:01:10 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 19:01:10.938242 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25de2344-ccb7-4c1a-b3c2-60c48975aa2a None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:01:10.982885 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d7d5bd-4cae-4ae4-ab69-bf9f3f414be3 None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:01:10.997332 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:01:11.003914 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:01:11.027996 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd818093-39e6-48d6-be1e-2c5131e47ecf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:01:11.028938 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd818093-39e6-48d6-be1e-2c5131e47ecf None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:01:11.029385 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd818093-39e6-48d6-be1e-2c5131e47ecf None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:01:11.029903 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd818093-39e6-48d6-be1e-2c5131e47ecf None admin] PATH_INFO: `/v3/groups/b9cd1ff07b954a08860e9a9837c816b3` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:01:11.031055 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd818093-39e6-48d6-be1e-2c5131e47ecf None admin] RBAC: Authorizing `identity:get_group(group_id=b9cd1ff07b954a08860e9a9837c816b3)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:01:11.032498 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd818093-39e6-48d6-be1e-2c5131e47ecf None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:01:11.034342 dv-cinder-862365-1-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 161/324] 10.222.0.23 () {56 vars in 1180 bytes} [Fri Oct 28 19:01:10 2022] GET /identity/v3/groups/b9cd1ff07b954a08860e9a9837c816b3 => generated 226 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:01:11.040276 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd818093-39e6-48d6-be1e-2c5131e47ecf None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:01:11.067256 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25de2344-ccb7-4c1a-b3c2-60c48975aa2a None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:01:11.106105 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1942c7-0666-403b-93ca-b1972e38cee8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:01:11.106771 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1942c7-0666-403b-93ca-b1972e38cee8 None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:01:11.107014 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1942c7-0666-403b-93ca-b1972e38cee8 None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:01:11.107339 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1942c7-0666-403b-93ca-b1972e38cee8 None admin] PATH_INFO: `/v3/roles` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:01:11.109120 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1942c7-0666-403b-93ca-b1972e38cee8 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81765) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:01:11.109467 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1942c7-0666-403b-93ca-b1972e38cee8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:01:11.110842 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1942c7-0666-403b-93ca-b1972e38cee8 None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:01:11.120764 dv-cinder-862365-1-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 164/325] 10.222.0.23 () {56 vars in 1111 bytes} [Fri Oct 28 19:01:10 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 19:01:11.127553 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1942c7-0666-403b-93ca-b1972e38cee8 None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:01:11.170773 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd818093-39e6-48d6-be1e-2c5131e47ecf None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:01:11.212506 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2c211a-f901-436d-a73f-269f8b234f40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:01:11.213049 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2c211a-f901-436d-a73f-269f8b234f40 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:01:11.213328 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2c211a-f901-436d-a73f-269f8b234f40 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:01:11.213692 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2c211a-f901-436d-a73f-269f8b234f40 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:01:11.214432 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2c211a-f901-436d-a73f-269f8b234f40 None admin] RBAC: Adding query filter params (group.id=b9cd1ff07b954a08860e9a9837c816b3, role.id=a11a1b300fe044b5a905284bc623dc41, scope.project.id=575e6206099b4a24bc9b829f3e7b6bdc) {{(pid=81766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:01:11.214742 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2c211a-f901-436d-a73f-269f8b234f40 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:01:11.216177 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2c211a-f901-436d-a73f-269f8b234f40 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:01:11.223864 dv-cinder-862365-1-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 162/326] 10.222.0.23 () {56 vars in 1376 bytes} [Fri Oct 28 19:01:11 2022] GET /identity/v3/role_assignments?group.id=b9cd1ff07b954a08860e9a9837c816b3&scope.project.id=575e6206099b4a24bc9b829f3e7b6bdc&role.id=a11a1b300fe044b5a905284bc623dc41 => generated 611 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 19:01:11.225095 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2c211a-f901-436d-a73f-269f8b234f40 None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:01:11.268136 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1942c7-0666-403b-93ca-b1972e38cee8 None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:01:11.282292 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:01:11.282928 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:01:11.317294 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94722a44-989f-47e8-a6f1-e044eb264745 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:01:11.317977 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94722a44-989f-47e8-a6f1-e044eb264745 None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:01:11.318257 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94722a44-989f-47e8-a6f1-e044eb264745 None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:01:11.318531 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94722a44-989f-47e8-a6f1-e044eb264745 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:01:11.352531 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2c211a-f901-436d-a73f-269f8b234f40 None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:01:11.395762 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f44f07-172a-4595-ba89-aab2f5e3cdbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:01:11.396411 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f44f07-172a-4595-ba89-aab2f5e3cdbe None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:01:11.396689 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f44f07-172a-4595-ba89-aab2f5e3cdbe None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:01:11.396961 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f44f07-172a-4595-ba89-aab2f5e3cdbe None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:01:11.410034 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f44f07-172a-4595-ba89-aab2f5e3cdbe None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 19:01:11.412923 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94722a44-989f-47e8-a6f1-e044eb264745 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:01:11.414484 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94722a44-989f-47e8-a6f1-e044eb264745 None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:01:11.416210 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application [None req-e3f44f07-172a-4595-ba89-aab2f5e3cdbe None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 28 19:01:11.416210 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 19:01:11.416210 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 19:01:11.416210 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 19:01:11.416210 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 19:01:11.416210 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 19:01:11.416210 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 19:01:11.416210 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 19:01:11.416210 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 19:01:11.416210 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 19:01:11.416210 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 19:01:11.416210 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 19:01:11.416210 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 28 19:01:11.416210 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 28 19:01:11.416210 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 28 19:01:11.416210 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 28 19:01:11.417122 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 28 19:01:11.417122 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 28 19:01:11.417122 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 28 19:01:11.417122 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 28 19:01:11.417122 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 19:01:11.417122 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 19:01:11.417122 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 19:01:11.417122 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 19:01:11.417122 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 19:01:11.417122 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 19:01:11.417122 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 19:01:11.417122 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application with Lock( Oct 28 19:01:11.417122 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 19:01:11.417122 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._enter() Oct 28 19:01:11.417122 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 19:01:11.417122 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 19:01:11.417962 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 19:01:11.417962 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.creator() Oct 28 19:01:11.417962 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 19:01:11.417962 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application created_value = creator( Oct 28 19:01:11.417962 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 28 19:01:11.417962 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 28 19:01:11.417962 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 28 19:01:11.417962 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 28 19:01:11.417962 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 28 19:01:11.417962 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 28 19:01:11.417962 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 28 19:01:11.417962 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Oct 28 19:01:11.417962 dv-cinder-862365-1-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 163/327] 10.222.0.23 () {56 vars in 1096 bytes} [Fri Oct 28 19:01:11 2022] GET /identity/v3/roles/admin => generated 83 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 19:01:11.425197 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f44f07-172a-4595-ba89-aab2f5e3cdbe None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:01:11.528387 dv-cinder-862365-1-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 165/328] 10.222.0.23 () {58 vars in 1282 bytes} [Fri Oct 28 19:01:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 401 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 28 19:01:11.534607 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94722a44-989f-47e8-a6f1-e044eb264745 None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:01:11.548247 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f44f07-172a-4595-ba89-aab2f5e3cdbe None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:01:11.549967 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:01:11.552482 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:01:11.597050 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85794fe-9e89-40ed-9c32-431ec71e9921 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:01:11.597721 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85794fe-9e89-40ed-9c32-431ec71e9921 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:01:11.597998 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85794fe-9e89-40ed-9c32-431ec71e9921 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:01:11.598271 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85794fe-9e89-40ed-9c32-431ec71e9921 None admin] PATH_INFO: `/v3/roles` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:01:11.598932 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b85794fe-9e89-40ed-9c32-431ec71e9921 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:01:11.599231 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b85794fe-9e89-40ed-9c32-431ec71e9921 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:01:11.600642 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b85794fe-9e89-40ed-9c32-431ec71e9921 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:01:11.609786 dv-cinder-862365-1-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 164/329] 10.222.0.23 () {56 vars in 1099 bytes} [Fri Oct 28 19:01:11 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 19:01:11.615444 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85794fe-9e89-40ed-9c32-431ec71e9921 None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:01:11.667233 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94722a44-989f-47e8-a6f1-e044eb264745 None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:01:11.712134 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8f3114-09e1-49af-9838-777c3b734a49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:01:11.712776 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8f3114-09e1-49af-9838-777c3b734a49 None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:01:11.714217 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8f3114-09e1-49af-9838-777c3b734a49 None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:01:11.714217 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8f3114-09e1-49af-9838-777c3b734a49 None admin] PATH_INFO: `/v3/projects/0e59baa74fa1427ab5e2f47d5fb1e4c7` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:01:11.715183 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a8f3114-09e1-49af-9838-777c3b734a49 None admin] RBAC: Authorizing `identity:get_project(project_id=0e59baa74fa1427ab5e2f47d5fb1e4c7)` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:01:11.716814 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a8f3114-09e1-49af-9838-777c3b734a49 None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:01:11.718694 dv-cinder-862365-1-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 166/330] 10.222.0.23 () {56 vars in 1186 bytes} [Fri Oct 28 19:01:11 2022] GET /identity/v3/projects/0e59baa74fa1427ab5e2f47d5fb1e4c7 => generated 302 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 19:01:11.724953 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8f3114-09e1-49af-9838-777c3b734a49 None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:01:11.734982 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85794fe-9e89-40ed-9c32-431ec71e9921 None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:01:11.782070 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d9d8d3-5ab9-4443-a537-44710b6de91c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:01:11.783063 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d9d8d3-5ab9-4443-a537-44710b6de91c None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:01:11.783063 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d9d8d3-5ab9-4443-a537-44710b6de91c None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:01:11.783063 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d9d8d3-5ab9-4443-a537-44710b6de91c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:01:11.815513 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:01:11.822799 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:01:11.844012 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8f3114-09e1-49af-9838-777c3b734a49 None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:01:11.869401 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d9d8d3-5ab9-4443-a537-44710b6de91c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:01:11.871771 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d9d8d3-5ab9-4443-a537-44710b6de91c None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:01:11.887128 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1329adcf-f5bc-4ac4-beb1-aa10eb43a566 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:01:11.887767 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1329adcf-f5bc-4ac4-beb1-aa10eb43a566 None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:01:11.888048 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1329adcf-f5bc-4ac4-beb1-aa10eb43a566 None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:01:11.888325 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1329adcf-f5bc-4ac4-beb1-aa10eb43a566 None admin] PATH_INFO: `/v3/groups/b9cd1ff07b954a08860e9a9837c816b3` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:01:11.889459 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1329adcf-f5bc-4ac4-beb1-aa10eb43a566 None admin] RBAC: Authorizing `identity:get_group(group_id=b9cd1ff07b954a08860e9a9837c816b3)` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:01:11.890883 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1329adcf-f5bc-4ac4-beb1-aa10eb43a566 None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:01:11.892485 dv-cinder-862365-1-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 167/331] 10.222.0.23 () {56 vars in 1180 bytes} [Fri Oct 28 19:01:11 2022] GET /identity/v3/groups/b9cd1ff07b954a08860e9a9837c816b3 => generated 226 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:01:11.898586 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1329adcf-f5bc-4ac4-beb1-aa10eb43a566 None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:01:11.970226 dv-cinder-862365-1-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 165/332] 10.222.0.23 () {58 vars in 1282 bytes} [Fri Oct 28 19:01:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Oct 28 19:01:11.975728 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d9d8d3-5ab9-4443-a537-44710b6de91c None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:01:11.996606 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1329adcf-f5bc-4ac4-beb1-aa10eb43a566 None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:01:12.029531 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a00cbaa-0a75-4c8c-8c08-b7d57637f1a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:01:12.030122 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a00cbaa-0a75-4c8c-8c08-b7d57637f1a1 None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:01:12.030397 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a00cbaa-0a75-4c8c-8c08-b7d57637f1a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:01:12.030668 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a00cbaa-0a75-4c8c-8c08-b7d57637f1a1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:01:12.031379 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a00cbaa-0a75-4c8c-8c08-b7d57637f1a1 None admin] RBAC: Adding query filter params (group.id=b9cd1ff07b954a08860e9a9837c816b3, role.id=a11a1b300fe044b5a905284bc623dc41, scope.project.id=0e59baa74fa1427ab5e2f47d5fb1e4c7) {{(pid=81765) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:01:12.031682 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a00cbaa-0a75-4c8c-8c08-b7d57637f1a1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:01:12.033158 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a00cbaa-0a75-4c8c-8c08-b7d57637f1a1 None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:01:12.035702 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:01:12.039104 dv-cinder-862365-1-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 168/333] 10.222.0.23 () {56 vars in 1376 bytes} [Fri Oct 28 19:01:11 2022] GET /identity/v3/role_assignments?group.id=b9cd1ff07b954a08860e9a9837c816b3&scope.project.id=0e59baa74fa1427ab5e2f47d5fb1e4c7&role.id=a11a1b300fe044b5a905284bc623dc41 => generated 611 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 19:01:12.075906 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d9d8d3-5ab9-4443-a537-44710b6de91c None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:01:12.111925 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566d0abd-fa10-4ee5-97ed-ecf3e5b5db60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:01:12.112566 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566d0abd-fa10-4ee5-97ed-ecf3e5b5db60 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:01:12.112844 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566d0abd-fa10-4ee5-97ed-ecf3e5b5db60 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:01:12.113116 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566d0abd-fa10-4ee5-97ed-ecf3e5b5db60 None admin] PATH_INFO: `/v3/projects/5b7477232f9249b8beb26277f784d073` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:01:12.114302 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566d0abd-fa10-4ee5-97ed-ecf3e5b5db60 None admin] RBAC: Authorizing `identity:get_project(project_id=5b7477232f9249b8beb26277f784d073)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:01:12.115762 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566d0abd-fa10-4ee5-97ed-ecf3e5b5db60 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:01:12.122546 dv-cinder-862365-1-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 166/334] 10.222.0.23 () {56 vars in 1186 bytes} [Fri Oct 28 19:01:11 2022] GET /identity/v3/projects/5b7477232f9249b8beb26277f784d073 => generated 344 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 19:01:12.123725 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a00cbaa-0a75-4c8c-8c08-b7d57637f1a1 None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:01:12.137750 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:01:12.227943 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a00cbaa-0a75-4c8c-8c08-b7d57637f1a1 None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:01:12.260091 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c841a253-28b9-45b4-af14-a283b181243e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:01:12.261266 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c841a253-28b9-45b4-af14-a283b181243e None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:01:12.261656 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c841a253-28b9-45b4-af14-a283b181243e None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:01:12.261932 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c841a253-28b9-45b4-af14-a283b181243e None admin] PATH_INFO: `/v3/groups/04ce5014e7564e4c99f6375062b24cd3` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:01:12.263042 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c841a253-28b9-45b4-af14-a283b181243e None admin] RBAC: Authorizing `identity:get_group(group_id=04ce5014e7564e4c99f6375062b24cd3)` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:01:12.264620 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c841a253-28b9-45b4-af14-a283b181243e None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:01:12.268294 dv-cinder-862365-1-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 169/335] 10.222.0.23 () {56 vars in 1180 bytes} [Fri Oct 28 19:01:12 2022] GET /identity/v3/groups/04ce5014e7564e4c99f6375062b24cd3 => generated 229 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:01:12.272110 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566d0abd-fa10-4ee5-97ed-ecf3e5b5db60 None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:01:12.376774 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566d0abd-fa10-4ee5-97ed-ecf3e5b5db60 None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:01:12.406177 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:01:12.410986 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8216c923-cf45-473b-818b-212181e33be8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:01:12.411590 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8216c923-cf45-473b-818b-212181e33be8 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:01:12.411870 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8216c923-cf45-473b-818b-212181e33be8 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:01:12.412146 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8216c923-cf45-473b-818b-212181e33be8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:01:12.412867 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8216c923-cf45-473b-818b-212181e33be8 None admin] RBAC: Adding query filter params (group.id=04ce5014e7564e4c99f6375062b24cd3, role.id=a9e4e47c2bf448fcbada91c1174644f7, scope.project.id=5b7477232f9249b8beb26277f784d073) {{(pid=81766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:01:12.413178 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8216c923-cf45-473b-818b-212181e33be8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:01:12.414646 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8216c923-cf45-473b-818b-212181e33be8 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:01:12.420294 dv-cinder-862365-1-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 167/336] 10.222.0.23 () {56 vars in 1376 bytes} [Fri Oct 28 19:01:12 2022] GET /identity/v3/role_assignments?group.id=04ce5014e7564e4c99f6375062b24cd3&scope.project.id=5b7477232f9249b8beb26277f784d073&role.id=a9e4e47c2bf448fcbada91c1174644f7 => generated 611 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:01:15.034027 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7f96c6-1b92-4144-a62c-b848e8bebb55 None None] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:01:15.035129 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7f96c6-1b92-4144-a62c-b848e8bebb55 None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:01:15.035616 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7f96c6-1b92-4144-a62c-b848e8bebb55 None None] PATH_INFO: `/` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:01:15.037278 dv-cinder-862365-1-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 170/337] 10.222.0.23 () {54 vars in 927 bytes} [Fri Oct 28 19:01:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 19:01:15.043535 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a90da7f-d09a-4333-8f36-5e7474f6ad98 None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:01:15.044714 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a90da7f-d09a-4333-8f36-5e7474f6ad98 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:01:15.045278 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a90da7f-d09a-4333-8f36-5e7474f6ad98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:01:15.070598 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-0a90da7f-d09a-4333-8f36-5e7474f6ad98 None None] MFA Rules not processed for user `ae863915635746d1ac19970949de4722`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:01:15.072146 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-0a90da7f-d09a-4333-8f36-5e7474f6ad98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:01:15.155551 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b580d18-621d-4da3-b2b6-cd950c37725e None None] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:01:15.155853 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b580d18-621d-4da3-b2b6-cd950c37725e None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:01:15.156081 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b580d18-621d-4da3-b2b6-cd950c37725e None None] PATH_INFO: `/` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:01:15.157691 dv-cinder-862365-1-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 171/338] 10.222.0.23 () {54 vars in 927 bytes} [Fri Oct 28 19:01:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 19:01:15.159826 dv-cinder-862365-1-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 168/339] 10.222.0.23 () {58 vars in 1024 bytes} [Fri Oct 28 19:01:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 28 19:01:15.162751 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd61280-d100-4029-8744-6f67b2e1fe50 None None] REQUEST_METHOD: `POST` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:01:15.163041 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd61280-d100-4029-8744-6f67b2e1fe50 None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:01:15.163324 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd61280-d100-4029-8744-6f67b2e1fe50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:01:15.202351 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.auth.core [None req-ebd61280-d100-4029-8744-6f67b2e1fe50 None None] MFA Rules not processed for user `ae863915635746d1ac19970949de4722`. Rule list: `[]` (Enabled: `True`). {{(pid=81765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:01:15.203568 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-ebd61280-d100-4029-8744-6f67b2e1fe50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:01:15.311616 dv-cinder-862365-1-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 172/340] 10.222.0.23 () {58 vars in 1024 bytes} [Fri Oct 28 19:01:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 28 19:01:15.456124 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a2e124-e7cc-4ccb-afce-027fa408a650 None None] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:01:15.456456 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a2e124-e7cc-4ccb-afce-027fa408a650 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:01:15.456632 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a2e124-e7cc-4ccb-afce-027fa408a650 None None] PATH_INFO: `/` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:01:15.457978 dv-cinder-862365-1-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 169/341] 10.222.0.23 () {54 vars in 927 bytes} [Fri Oct 28 19:01:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 19:01:15.463456 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baba86aa-21f0-48cc-8342-bfbd0a12050d None None] REQUEST_METHOD: `POST` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:01:15.463780 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baba86aa-21f0-48cc-8342-bfbd0a12050d None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:01:15.464055 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baba86aa-21f0-48cc-8342-bfbd0a12050d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:01:15.494335 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.auth.core [None req-baba86aa-21f0-48cc-8342-bfbd0a12050d None None] MFA Rules not processed for user `ae863915635746d1ac19970949de4722`. Rule list: `[]` (Enabled: `True`). {{(pid=81765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:01:15.496080 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-baba86aa-21f0-48cc-8342-bfbd0a12050d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:01:15.498158 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:01:15.591940 dv-cinder-862365-1-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 173/342] 10.222.0.23 () {58 vars in 1024 bytes} [Fri Oct 28 19:01:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 28 19:01:15.629130 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a2e124-e7cc-4ccb-afce-027fa408a650 None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:01:15.651595 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baba86aa-21f0-48cc-8342-bfbd0a12050d None None] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:01:15.783552 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baba86aa-21f0-48cc-8342-bfbd0a12050d None None] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:01:15.824963 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b59d556-55c8-48d6-9e0d-57030dc934e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:01:15.825618 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b59d556-55c8-48d6-9e0d-57030dc934e9 None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:01:15.825898 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b59d556-55c8-48d6-9e0d-57030dc934e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:01:15.826171 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b59d556-55c8-48d6-9e0d-57030dc934e9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:01:15.834924 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:01:15.842313 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b59d556-55c8-48d6-9e0d-57030dc934e9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:01:15.843740 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b59d556-55c8-48d6-9e0d-57030dc934e9 None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:01:15.857339 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a2e124-e7cc-4ccb-afce-027fa408a650 None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:01:15.879411 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application [None req-2b59d556-55c8-48d6-9e0d-57030dc934e9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 19:01:15.879411 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 19:01:15.879411 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 19:01:15.879411 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 19:01:15.879411 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 19:01:15.879411 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 19:01:15.879411 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 19:01:15.879411 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 19:01:15.879411 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 19:01:15.879411 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 19:01:15.879411 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 19:01:15.879411 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 19:01:15.879411 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 28 19:01:15.879411 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 28 19:01:15.879411 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 28 19:01:15.879411 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 28 19:01:15.880415 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 19:01:15.880415 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 19:01:15.880415 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 19:01:15.880415 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 19:01:15.880415 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 19:01:15.880415 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 19:01:15.880415 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 19:01:15.880415 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application with Lock( Oct 28 19:01:15.880415 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 19:01:15.880415 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._enter() Oct 28 19:01:15.880415 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 19:01:15.880415 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 19:01:15.880415 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 19:01:15.880415 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.creator() Oct 28 19:01:15.880415 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 19:01:15.880415 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application created_value = creator( Oct 28 19:01:15.880415 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 28 19:01:15.881294 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 28 19:01:15.881294 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 19:01:15.881294 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application Oct 28 19:01:15.883602 dv-cinder-862365-1-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 174/343] 10.222.0.23 () {56 vars in 1108 bytes} [Fri Oct 28 19:01:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 28 19:01:15.889331 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b59d556-55c8-48d6-9e0d-57030dc934e9 None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:01:15.913886 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:01:15.929790 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3453fba-3172-498f-9206-c8e253c31788 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:01:15.930531 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3453fba-3172-498f-9206-c8e253c31788 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:01:15.930806 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3453fba-3172-498f-9206-c8e253c31788 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:01:15.931078 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3453fba-3172-498f-9206-c8e253c31788 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:01:15.943119 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3453fba-3172-498f-9206-c8e253c31788 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:01:15.944575 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3453fba-3172-498f-9206-c8e253c31788 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:01:15.960524 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application [None req-a3453fba-3172-498f-9206-c8e253c31788 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 19:01:15.960524 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 19:01:15.960524 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 19:01:15.960524 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 19:01:15.960524 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 19:01:15.960524 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 19:01:15.960524 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 19:01:15.960524 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 19:01:15.960524 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 19:01:15.960524 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 19:01:15.960524 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 19:01:15.960524 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 19:01:15.960524 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 28 19:01:15.960524 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 28 19:01:15.960524 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 28 19:01:15.960524 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 28 19:01:15.961768 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 19:01:15.961768 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 19:01:15.961768 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 19:01:15.961768 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 19:01:15.961768 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 19:01:15.961768 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 19:01:15.961768 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 19:01:15.961768 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application with Lock( Oct 28 19:01:15.961768 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 19:01:15.961768 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._enter() Oct 28 19:01:15.961768 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 19:01:15.961768 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 19:01:15.961768 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 19:01:15.961768 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.creator() Oct 28 19:01:15.961768 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 19:01:15.961768 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application created_value = creator( Oct 28 19:01:15.961768 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 28 19:01:15.962635 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 28 19:01:15.962635 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 19:01:15.962635 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Oct 28 19:01:15.962635 dv-cinder-862365-1-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 170/344] 10.222.0.23 () {56 vars in 1108 bytes} [Fri Oct 28 19:01:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 333 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 19:01:15.963286 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3453fba-3172-498f-9206-c8e253c31788 None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:01:16.021085 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b59d556-55c8-48d6-9e0d-57030dc934e9 None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:01:16.056147 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1afb514a-17bb-45f8-91a0-f532c7da0fad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:01:16.056806 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afb514a-17bb-45f8-91a0-f532c7da0fad None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:01:16.057040 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afb514a-17bb-45f8-91a0-f532c7da0fad None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:01:16.057911 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afb514a-17bb-45f8-91a0-f532c7da0fad None admin] PATH_INFO: `/v3/domains` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:01:16.058570 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1afb514a-17bb-45f8-91a0-f532c7da0fad None admin] RBAC: Adding query filter params (name=Default) {{(pid=81765) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:01:16.058877 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1afb514a-17bb-45f8-91a0-f532c7da0fad None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:01:16.060255 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1afb514a-17bb-45f8-91a0-f532c7da0fad None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:01:16.069487 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3453fba-3172-498f-9206-c8e253c31788 None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:01:16.074045 dv-cinder-862365-1-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 175/345] 10.222.0.23 () {56 vars in 1109 bytes} [Fri Oct 28 19:01:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 19:01:16.078123 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1afb514a-17bb-45f8-91a0-f532c7da0fad None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:01:16.103615 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e652b4-8903-4595-9251-1a392a509d13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:01:16.104272 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e652b4-8903-4595-9251-1a392a509d13 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:01:16.104559 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e652b4-8903-4595-9251-1a392a509d13 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:01:16.104832 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e652b4-8903-4595-9251-1a392a509d13 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:01:16.115196 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e652b4-8903-4595-9251-1a392a509d13 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:01:16.116644 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e652b4-8903-4595-9251-1a392a509d13 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:01:16.131438 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application [None req-d8e652b4-8903-4595-9251-1a392a509d13 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 19:01:16.131438 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 19:01:16.131438 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 19:01:16.131438 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 19:01:16.131438 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 19:01:16.131438 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 19:01:16.131438 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 19:01:16.131438 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 19:01:16.131438 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 19:01:16.131438 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 19:01:16.131438 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 19:01:16.131438 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 19:01:16.131438 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 28 19:01:16.131438 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 28 19:01:16.131438 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 28 19:01:16.131438 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 28 19:01:16.132344 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 19:01:16.132344 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 19:01:16.132344 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 19:01:16.132344 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 19:01:16.132344 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 19:01:16.132344 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 19:01:16.132344 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 19:01:16.132344 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application with Lock( Oct 28 19:01:16.132344 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 19:01:16.132344 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._enter() Oct 28 19:01:16.132344 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 19:01:16.132344 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 19:01:16.132344 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 19:01:16.132344 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.creator() Oct 28 19:01:16.132344 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 19:01:16.132344 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application created_value = creator( Oct 28 19:01:16.132344 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 28 19:01:16.139203 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 28 19:01:16.139203 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 19:01:16.139203 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Oct 28 19:01:16.139203 dv-cinder-862365-1-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 171/346] 10.222.0.23 () {56 vars in 1108 bytes} [Fri Oct 28 19:01:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 19:01:16.139203 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fa9917-7c39-492d-bb36-6cda5066666e None None] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:01:16.139483 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:01:16.139558 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fa9917-7c39-492d-bb36-6cda5066666e None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:01:16.139558 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fa9917-7c39-492d-bb36-6cda5066666e None None] PATH_INFO: `/` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:01:16.139558 dv-cinder-862365-1-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 172/347] 10.222.0.23 () {54 vars in 927 bytes} [Fri Oct 28 19:01:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 19:01:16.139558 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0fa9917-7c39-492d-bb36-6cda5066666e None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:01:16.169978 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:01:16.190503 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1afb514a-17bb-45f8-91a0-f532c7da0fad None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:01:16.227898 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27557964-d38f-4f7f-82ab-ae2e1808f817 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:01:16.228506 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27557964-d38f-4f7f-82ab-ae2e1808f817 None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:01:16.228782 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27557964-d38f-4f7f-82ab-ae2e1808f817 None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:01:16.229055 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27557964-d38f-4f7f-82ab-ae2e1808f817 None admin] PATH_INFO: `/v3/domains` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:01:16.229752 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27557964-d38f-4f7f-82ab-ae2e1808f817 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81765) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:01:16.230053 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27557964-d38f-4f7f-82ab-ae2e1808f817 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:01:16.231420 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27557964-d38f-4f7f-82ab-ae2e1808f817 None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:01:16.242761 dv-cinder-862365-1-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 176/348] 10.222.0.23 () {56 vars in 1109 bytes} [Fri Oct 28 19:01:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:01:16.243556 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27557964-d38f-4f7f-82ab-ae2e1808f817 None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:01:16.253391 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0fa9917-7c39-492d-bb36-6cda5066666e None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:01:16.288851 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2974f2f4-5976-4cae-ab66-a8280be3acd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:01:16.289701 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2974f2f4-5976-4cae-ab66-a8280be3acd3 None admin] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:01:16.290123 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2974f2f4-5976-4cae-ab66-a8280be3acd3 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:01:16.290666 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2974f2f4-5976-4cae-ab66-a8280be3acd3 None admin] PATH_INFO: `/v3/users` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:01:16.291306 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2974f2f4-5976-4cae-ab66-a8280be3acd3 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:01:16.292967 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2974f2f4-5976-4cae-ab66-a8280be3acd3 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:01:16.344306 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27557964-d38f-4f7f-82ab-ae2e1808f817 None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:01:16.354331 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:01:16.362522 dv-cinder-862365-1-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 173/349] 10.222.0.23 () {60 vars in 1132 bytes} [Fri Oct 28 19:01:16 2022] POST /identity/v3/users => generated 246 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 19:01:16.365134 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f733b795-d8a6-4214-973d-d3fd4b14616f None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:01:16.365134 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f733b795-d8a6-4214-973d-d3fd4b14616f None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:01:16.365134 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f733b795-d8a6-4214-973d-d3fd4b14616f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:01:16.385270 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-f733b795-d8a6-4214-973d-d3fd4b14616f None None] MFA Rules not processed for user `ae863915635746d1ac19970949de4722`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:01:16.387146 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-f733b795-d8a6-4214-973d-d3fd4b14616f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:01:16.389725 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381b1608-1166-4fde-9801-493568cc0701 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:01:16.390762 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381b1608-1166-4fde-9801-493568cc0701 None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:01:16.391049 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381b1608-1166-4fde-9801-493568cc0701 None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:01:16.391331 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381b1608-1166-4fde-9801-493568cc0701 None admin] PATH_INFO: `/v3/domains` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:01:16.392047 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381b1608-1166-4fde-9801-493568cc0701 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81765) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:01:16.392360 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381b1608-1166-4fde-9801-493568cc0701 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:01:16.393933 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381b1608-1166-4fde-9801-493568cc0701 None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:01:16.408878 dv-cinder-862365-1-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 177/350] 10.222.0.23 () {56 vars in 1109 bytes} [Fri Oct 28 19:01:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:01:16.412833 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381b1608-1166-4fde-9801-493568cc0701 None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:01:16.469161 dv-cinder-862365-1-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 174/351] 10.222.0.23 () {58 vars in 1024 bytes} [Fri Oct 28 19:01:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 28 19:01:16.478942 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f733b795-d8a6-4214-973d-d3fd4b14616f None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:01:16.516550 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:01:16.545803 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381b1608-1166-4fde-9801-493568cc0701 None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:01:16.615869 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cdc113e-69fb-4239-8f25-8eff8ea391ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:01:16.616406 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdc113e-69fb-4239-8f25-8eff8ea391ef None admin] REQUEST_METHOD: `POST` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:01:16.616867 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdc113e-69fb-4239-8f25-8eff8ea391ef None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:01:16.617147 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdc113e-69fb-4239-8f25-8eff8ea391ef None admin] PATH_INFO: `/v3/users` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:01:16.618672 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cdc113e-69fb-4239-8f25-8eff8ea391ef None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:01:16.620154 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cdc113e-69fb-4239-8f25-8eff8ea391ef None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:01:16.653152 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f733b795-d8a6-4214-973d-d3fd4b14616f None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:01:16.688414 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae75c081-5496-456b-b307-7345991bb364 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:01:16.689041 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae75c081-5496-456b-b307-7345991bb364 None admin] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:01:16.689322 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae75c081-5496-456b-b307-7345991bb364 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:01:16.694396 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae75c081-5496-456b-b307-7345991bb364 None admin] PATH_INFO: `/v3/users` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:01:16.694396 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae75c081-5496-456b-b307-7345991bb364 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:01:16.694396 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae75c081-5496-456b-b307-7345991bb364 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:01:16.718265 dv-cinder-862365-1-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 178/352] 10.222.0.23 () {60 vars in 1132 bytes} [Fri Oct 28 19:01:16 2022] POST /identity/v3/users => generated 248 bytes in 309 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 19:01:16.725819 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca6206d-3fa1-465b-ad3a-657a8ba8d22c None None] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:01:16.725819 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca6206d-3fa1-465b-ad3a-657a8ba8d22c None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:01:16.725819 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca6206d-3fa1-465b-ad3a-657a8ba8d22c None None] PATH_INFO: `/` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:01:16.726227 dv-cinder-862365-1-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 179/353] 10.222.0.23 () {54 vars in 927 bytes} [Fri Oct 28 19:01:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 19:01:16.728905 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffd2dac-0afa-4d66-b70c-59db452da413 None None] REQUEST_METHOD: `POST` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:01:16.729497 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffd2dac-0afa-4d66-b70c-59db452da413 None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:01:16.729979 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffd2dac-0afa-4d66-b70c-59db452da413 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:01:16.758302 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.auth.core [None req-5ffd2dac-0afa-4d66-b70c-59db452da413 None None] MFA Rules not processed for user `ae863915635746d1ac19970949de4722`. Rule list: `[]` (Enabled: `True`). {{(pid=81765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:01:16.759603 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-5ffd2dac-0afa-4d66-b70c-59db452da413 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:01:16.786292 dv-cinder-862365-1-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 175/354] 10.222.0.23 () {60 vars in 1132 bytes} [Fri Oct 28 19:01:16 2022] POST /identity/v3/users => generated 248 bytes in 308 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 19:01:16.790505 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae75c081-5496-456b-b307-7345991bb364 None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:01:16.804986 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:01:16.917502 dv-cinder-862365-1-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 180/355] 10.222.0.23 () {58 vars in 1024 bytes} [Fri Oct 28 19:01:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 28 19:01:16.938652 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:01:16.975407 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae75c081-5496-456b-b307-7345991bb364 None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:01:17.014084 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4650de-eb1a-445c-bcc5-643cfe1130e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:01:17.014986 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4650de-eb1a-445c-bcc5-643cfe1130e6 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:01:17.015417 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4650de-eb1a-445c-bcc5-643cfe1130e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:01:17.015833 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4650de-eb1a-445c-bcc5-643cfe1130e6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:01:17.028161 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4650de-eb1a-445c-bcc5-643cfe1130e6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:01:17.029930 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4650de-eb1a-445c-bcc5-643cfe1130e6 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:01:17.046504 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application [None req-cb4650de-eb1a-445c-bcc5-643cfe1130e6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 19:01:17.046504 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 19:01:17.046504 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 19:01:17.046504 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 19:01:17.046504 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 19:01:17.046504 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 19:01:17.046504 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 19:01:17.046504 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 19:01:17.046504 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 19:01:17.046504 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 19:01:17.046504 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 19:01:17.046504 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 19:01:17.046504 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 28 19:01:17.046504 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 28 19:01:17.046504 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 28 19:01:17.046504 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 28 19:01:17.047706 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 19:01:17.047706 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 19:01:17.047706 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 19:01:17.047706 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 19:01:17.047706 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 19:01:17.047706 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 19:01:17.047706 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 19:01:17.047706 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application with Lock( Oct 28 19:01:17.047706 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 19:01:17.047706 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._enter() Oct 28 19:01:17.047706 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 19:01:17.047706 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 19:01:17.047706 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 19:01:17.047706 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.creator() Oct 28 19:01:17.047706 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 19:01:17.047706 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application created_value = creator( Oct 28 19:01:17.047706 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 28 19:01:17.048722 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 28 19:01:17.048722 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 19:01:17.048722 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Oct 28 19:01:17.053067 dv-cinder-862365-1-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 176/356] 10.222.0.23 () {56 vars in 1108 bytes} [Fri Oct 28 19:01:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 19:01:17.057950 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ffd2dac-0afa-4d66-b70c-59db452da413 None None] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:01:17.199712 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ffd2dac-0afa-4d66-b70c-59db452da413 None None] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:01:17.242619 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4650de-eb1a-445c-bcc5-643cfe1130e6 None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:01:17.246556 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c211cd-4a8e-4e5a-b3e4-81f8673886a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:01:17.247170 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c211cd-4a8e-4e5a-b3e4-81f8673886a5 None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:01:17.247445 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c211cd-4a8e-4e5a-b3e4-81f8673886a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:01:17.247712 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c211cd-4a8e-4e5a-b3e4-81f8673886a5 None admin] PATH_INFO: `/v3/domains` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:01:17.248363 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c211cd-4a8e-4e5a-b3e4-81f8673886a5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81765) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:01:17.248660 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c211cd-4a8e-4e5a-b3e4-81f8673886a5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:01:17.250063 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c211cd-4a8e-4e5a-b3e4-81f8673886a5 None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:01:17.262977 dv-cinder-862365-1-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 181/357] 10.222.0.23 () {56 vars in 1109 bytes} [Fri Oct 28 19:01:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:01:17.268572 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c211cd-4a8e-4e5a-b3e4-81f8673886a5 None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:01:17.303009 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:01:17.387342 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4650de-eb1a-445c-bcc5-643cfe1130e6 None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:01:17.413770 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:01:17.426436 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a6b9e6-a32f-4bb5-b6b4-a1fe6f4bf5ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:01:17.427072 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a6b9e6-a32f-4bb5-b6b4-a1fe6f4bf5ec None admin] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:01:17.427410 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a6b9e6-a32f-4bb5-b6b4-a1fe6f4bf5ec None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:01:17.427640 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a6b9e6-a32f-4bb5-b6b4-a1fe6f4bf5ec None admin] PATH_INFO: `/v3/roles` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:01:17.428324 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a6b9e6-a32f-4bb5-b6b4-a1fe6f4bf5ec None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:01:17.429822 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a6b9e6-a32f-4bb5-b6b4-a1fe6f4bf5ec None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:01:17.451717 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c211cd-4a8e-4e5a-b3e4-81f8673886a5 None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:01:17.485832 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.sql.core [None req-e9a6b9e6-a32f-4bb5-b6b4-a1fe6f4bf5ec None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Oct 28 19:01:17.485832 dv-cinder-862365-1-smb devstack@keystone.service[81766]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Oct 28 19:01:17.485832 dv-cinder-862365-1-smb devstack@keystone.service[81766]: [parameters: {'id': 'ea38305194864039be0bc5e5f29ff3fa', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Oct 28 19:01:17.485832 dv-cinder-862365-1-smb devstack@keystone.service[81766]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81766) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Oct 28 19:01:17.504252 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ea909c-bd48-4378-bb32-484002e73fbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:01:17.505199 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ea909c-bd48-4378-bb32-484002e73fbd None admin] REQUEST_METHOD: `POST` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:01:17.506334 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ea909c-bd48-4378-bb32-484002e73fbd None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:01:17.506334 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ea909c-bd48-4378-bb32-484002e73fbd None admin] PATH_INFO: `/v3/users` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:01:17.506917 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ea909c-bd48-4378-bb32-484002e73fbd None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:01:17.508062 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application [None req-e9a6b9e6-a32f-4bb5-b6b4-a1fe6f4bf5ec None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Oct 28 19:01:17.508062 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 19:01:17.508062 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 28 19:01:17.508062 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 28 19:01:17.508062 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 28 19:01:17.508062 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 28 19:01:17.508062 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 28 19:01:17.508062 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application result = self._query(query) Oct 28 19:01:17.508062 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 28 19:01:17.508062 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application conn.query(q) Oct 28 19:01:17.508062 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 28 19:01:17.508062 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 28 19:01:17.508062 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 28 19:01:17.508062 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application result.read() Oct 28 19:01:17.508062 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 28 19:01:17.508889 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 28 19:01:17.508889 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 28 19:01:17.508889 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 28 19:01:17.508889 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 28 19:01:17.508889 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 28 19:01:17.508889 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 28 19:01:17.508889 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 28 19:01:17.508889 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Oct 28 19:01:17.508889 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Oct 28 19:01:17.508889 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Oct 28 19:01:17.508889 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Oct 28 19:01:17.508889 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 19:01:17.508889 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Oct 28 19:01:17.508889 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return method(*args, **kwargs) Oct 28 19:01:17.508889 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Oct 28 19:01:17.508889 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return ref.to_dict() Oct 28 19:01:17.508889 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 28 19:01:17.508889 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application next(self.gen) Oct 28 19:01:17.514067 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1068, in _transaction_scope Oct 28 19:01:17.514067 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application yield resource Oct 28 19:01:17.514067 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 28 19:01:17.514067 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application next(self.gen) Oct 28 19:01:17.514067 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 670, in _session Oct 28 19:01:17.514067 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application self.session.rollback() Oct 28 19:01:17.514067 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 28 19:01:17.514067 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application self.force_reraise() Oct 28 19:01:17.514067 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 28 19:01:17.514067 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application raise self.value Oct 28 19:01:17.514067 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 667, in _session Oct 28 19:01:17.514067 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Oct 28 19:01:17.514067 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 695, in _end_session_transaction Oct 28 19:01:17.514067 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application session.commit() Oct 28 19:01:17.514067 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Oct 28 19:01:17.514067 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Oct 28 19:01:17.514067 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Oct 28 19:01:17.514914 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application self._prepare_impl() Oct 28 19:01:17.514914 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Oct 28 19:01:17.514914 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application self.session.flush() Oct 28 19:01:17.514914 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 28 19:01:17.514914 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application self._flush(objects) Oct 28 19:01:17.514914 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 28 19:01:17.514914 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Oct 28 19:01:17.514914 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 28 19:01:17.514914 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application compat.raise_( Oct 28 19:01:17.514914 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 28 19:01:17.514914 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application raise exception Oct 28 19:01:17.514914 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 28 19:01:17.514914 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application flush_context.execute() Oct 28 19:01:17.514914 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 28 19:01:17.514914 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application rec.execute(self) Oct 28 19:01:17.514914 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 28 19:01:17.514914 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Oct 28 19:01:17.515762 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 28 19:01:17.515762 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application _emit_insert_statements( Oct 28 19:01:17.515762 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Oct 28 19:01:17.515762 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application c = connection._execute_20( Oct 28 19:01:17.515762 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 28 19:01:17.515762 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Oct 28 19:01:17.515762 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 28 19:01:17.515762 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Oct 28 19:01:17.515762 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 28 19:01:17.515762 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application ret = self._execute_context( Oct 28 19:01:17.515762 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 28 19:01:17.515762 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Oct 28 19:01:17.515762 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 28 19:01:17.515762 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 28 19:01:17.515762 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 28 19:01:17.515762 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application raise exception Oct 28 19:01:17.516562 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 28 19:01:17.516562 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 28 19:01:17.516562 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 28 19:01:17.516562 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 28 19:01:17.516562 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 28 19:01:17.516562 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application result = self._query(query) Oct 28 19:01:17.516562 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 28 19:01:17.516562 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application conn.query(q) Oct 28 19:01:17.516562 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 28 19:01:17.516562 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 28 19:01:17.516562 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 28 19:01:17.516562 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application result.read() Oct 28 19:01:17.516562 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 28 19:01:17.516562 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 28 19:01:17.516562 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 28 19:01:17.516562 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 28 19:01:17.517404 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 28 19:01:17.517404 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 28 19:01:17.517404 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 28 19:01:17.517404 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 28 19:01:17.517404 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Oct 28 19:01:17.517404 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Oct 28 19:01:17.517404 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application [parameters: {'id': 'ea38305194864039be0bc5e5f29ff3fa', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Oct 28 19:01:17.517404 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 28 19:01:17.517404 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Oct 28 19:01:17.517404 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 28 19:01:17.517404 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Oct 28 19:01:17.517404 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 19:01:17.517404 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 19:01:17.517404 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 19:01:17.517404 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 19:01:17.517404 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 19:01:17.518217 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 19:01:17.518217 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 19:01:17.518217 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 19:01:17.518217 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 19:01:17.518217 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 19:01:17.518217 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 19:01:17.518217 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Oct 28 19:01:17.518217 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Oct 28 19:01:17.518217 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 19:01:17.518217 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 19:01:17.518217 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Oct 28 19:01:17.518217 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Oct 28 19:01:17.518217 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Oct 28 19:01:17.518217 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Oct 28 19:01:17.518217 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Oct 28 19:01:17.518217 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Oct 28 19:01:17.519030 dv-cinder-862365-1-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 177/358] 10.222.0.23 () {60 vars in 1131 bytes} [Fri Oct 28 19:01:17 2022] POST /identity/v3/roles => generated 144 bytes in 271 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Oct 28 19:01:17.522028 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ea909c-bd48-4378-bb32-484002e73fbd None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:01:17.523128 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a6b9e6-a32f-4bb5-b6b4-a1fe6f4bf5ec None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:01:17.611266 dv-cinder-862365-1-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 182/359] 10.222.0.23 () {60 vars in 1132 bytes} [Fri Oct 28 19:01:17 2022] POST /identity/v3/users => generated 249 bytes in 342 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 19:01:17.662007 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a6b9e6-a32f-4bb5-b6b4-a1fe6f4bf5ec None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:01:17.705313 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85f0599-554b-4472-b62b-f712299a3570 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:01:17.706412 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85f0599-554b-4472-b62b-f712299a3570 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:01:17.706871 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85f0599-554b-4472-b62b-f712299a3570 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:01:17.707336 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85f0599-554b-4472-b62b-f712299a3570 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:01:17.719794 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85f0599-554b-4472-b62b-f712299a3570 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 19:01:17.725740 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application [None req-a85f0599-554b-4472-b62b-f712299a3570 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 28 19:01:17.725740 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 19:01:17.725740 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 19:01:17.725740 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 19:01:17.725740 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 19:01:17.725740 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 19:01:17.725740 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 19:01:17.725740 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 19:01:17.725740 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 19:01:17.725740 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 19:01:17.725740 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 19:01:17.725740 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 19:01:17.725740 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 28 19:01:17.725740 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 28 19:01:17.725740 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 28 19:01:17.725740 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 28 19:01:17.726732 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 28 19:01:17.726732 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 28 19:01:17.726732 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 28 19:01:17.726732 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 28 19:01:17.726732 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 19:01:17.726732 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 19:01:17.726732 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 19:01:17.726732 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 19:01:17.726732 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 19:01:17.726732 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 19:01:17.726732 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 19:01:17.726732 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application with Lock( Oct 28 19:01:17.726732 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 19:01:17.726732 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._enter() Oct 28 19:01:17.726732 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 19:01:17.726732 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 19:01:17.727554 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 19:01:17.727554 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.creator() Oct 28 19:01:17.727554 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 19:01:17.727554 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application created_value = creator( Oct 28 19:01:17.727554 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 28 19:01:17.727554 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 28 19:01:17.727554 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 28 19:01:17.727554 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 28 19:01:17.727554 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 28 19:01:17.727554 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 28 19:01:17.727554 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 28 19:01:17.727554 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Oct 28 19:01:17.730373 dv-cinder-862365-1-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 178/360] 10.222.0.23 () {56 vars in 1114 bytes} [Fri Oct 28 19:01:17 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 19:01:17.736592 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ea909c-bd48-4378-bb32-484002e73fbd None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:01:17.876364 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:01:17.902178 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ea909c-bd48-4378-bb32-484002e73fbd None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:01:17.941595 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d17878-3b2a-45c9-8054-10b7924de4b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:01:17.942219 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d17878-3b2a-45c9-8054-10b7924de4b0 None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:01:17.942504 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d17878-3b2a-45c9-8054-10b7924de4b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:01:17.942786 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d17878-3b2a-45c9-8054-10b7924de4b0 None admin] PATH_INFO: `/v3/roles` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:01:17.943452 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d17878-3b2a-45c9-8054-10b7924de4b0 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81765) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:01:17.943915 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d17878-3b2a-45c9-8054-10b7924de4b0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:01:17.945944 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d17878-3b2a-45c9-8054-10b7924de4b0 None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:01:17.955207 dv-cinder-862365-1-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 183/361] 10.222.0.23 () {56 vars in 1111 bytes} [Fri Oct 28 19:01:17 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:01:18.779311 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a964b4-b0e7-4ee2-a913-b113481a6164 None None] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:01:18.779837 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a964b4-b0e7-4ee2-a913-b113481a6164 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:01:18.779914 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a964b4-b0e7-4ee2-a913-b113481a6164 None None] PATH_INFO: `/` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:01:18.781340 dv-cinder-862365-1-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 179/362] 10.222.0.23 () {54 vars in 927 bytes} [Fri Oct 28 19:01:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 19:01:18.786707 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55457ff-f502-48a3-a106-67a26c621942 None None] REQUEST_METHOD: `POST` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:01:18.787118 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55457ff-f502-48a3-a106-67a26c621942 None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:01:18.787291 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55457ff-f502-48a3-a106-67a26c621942 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:01:18.810273 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.auth.core [None req-b55457ff-f502-48a3-a106-67a26c621942 None None] MFA Rules not processed for user `ae863915635746d1ac19970949de4722`. Rule list: `[]` (Enabled: `True`). {{(pid=81765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:01:18.811486 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-b55457ff-f502-48a3-a106-67a26c621942 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:01:18.932165 dv-cinder-862365-1-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 184/363] 10.222.0.23 () {58 vars in 1024 bytes} [Fri Oct 28 19:01:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 28 19:01:19.330730 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a964b4-b0e7-4ee2-a913-b113481a6164 None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:01:19.390299 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:01:19.454933 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a964b4-b0e7-4ee2-a913-b113481a6164 None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:01:19.494697 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb28a78-9484-4a41-96f2-0f62d3f7192b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:01:19.495348 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb28a78-9484-4a41-96f2-0f62d3f7192b None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:01:19.495624 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb28a78-9484-4a41-96f2-0f62d3f7192b None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:01:19.495892 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb28a78-9484-4a41-96f2-0f62d3f7192b None admin] PATH_INFO: `/v3/roles/service` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:01:19.507665 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb28a78-9484-4a41-96f2-0f62d3f7192b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 19:01:19.513082 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application [None req-edb28a78-9484-4a41-96f2-0f62d3f7192b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 28 19:01:19.513082 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 19:01:19.513082 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 19:01:19.513082 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 19:01:19.513082 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 19:01:19.513082 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 19:01:19.513082 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 19:01:19.513082 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 19:01:19.513082 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 19:01:19.513082 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 19:01:19.513082 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 19:01:19.513082 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 19:01:19.513082 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 28 19:01:19.513082 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 28 19:01:19.513082 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 28 19:01:19.513082 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 28 19:01:19.514123 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 28 19:01:19.514123 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 28 19:01:19.514123 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 28 19:01:19.514123 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 28 19:01:19.514123 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 19:01:19.514123 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 19:01:19.514123 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 19:01:19.514123 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 19:01:19.514123 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 19:01:19.514123 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 19:01:19.514123 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 19:01:19.514123 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application with Lock( Oct 28 19:01:19.514123 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 19:01:19.514123 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._enter() Oct 28 19:01:19.514123 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 19:01:19.514123 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 19:01:19.515449 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 19:01:19.515449 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.creator() Oct 28 19:01:19.515449 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 19:01:19.515449 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application created_value = creator( Oct 28 19:01:19.515449 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 28 19:01:19.515449 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 28 19:01:19.515449 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 28 19:01:19.515449 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 28 19:01:19.515449 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 28 19:01:19.515449 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 28 19:01:19.515449 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 28 19:01:19.515449 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Oct 28 19:01:19.515449 dv-cinder-862365-1-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 180/364] 10.222.0.23 () {56 vars in 1102 bytes} [Fri Oct 28 19:01:19 2022] GET /identity/v3/roles/service => generated 85 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 19:01:19.520167 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55457ff-f502-48a3-a106-67a26c621942 None None] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:01:19.528476 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7490cee7-477f-42cb-bc3e-a10dc76edc39 None None] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:01:19.528756 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7490cee7-477f-42cb-bc3e-a10dc76edc39 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:01:19.529031 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7490cee7-477f-42cb-bc3e-a10dc76edc39 None None] PATH_INFO: `/` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:01:19.530367 dv-cinder-862365-1-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 181/365] 10.222.0.23 () {54 vars in 927 bytes} [Fri Oct 28 19:01:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 28 19:01:19.537139 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bece8b-500d-4b33-a406-79ad926a9b01 None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:01:19.537443 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bece8b-500d-4b33-a406-79ad926a9b01 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:01:19.538210 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bece8b-500d-4b33-a406-79ad926a9b01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:01:19.559542 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-22bece8b-500d-4b33-a406-79ad926a9b01 None None] MFA Rules not processed for user `ae863915635746d1ac19970949de4722`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:01:19.560734 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-22bece8b-500d-4b33-a406-79ad926a9b01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:01:19.633933 dv-cinder-862365-1-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 182/366] 10.222.0.23 () {58 vars in 1024 bytes} [Fri Oct 28 19:01:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 28 19:01:19.636194 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d426cd-de3f-4615-b62b-02131c478e8f None None] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:01:19.636694 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d426cd-de3f-4615-b62b-02131c478e8f None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:01:19.637189 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d426cd-de3f-4615-b62b-02131c478e8f None None] PATH_INFO: `/` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:01:19.641746 dv-cinder-862365-1-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 183/367] 10.222.0.23 () {54 vars in 927 bytes} [Fri Oct 28 19:01:19 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 19:01:19.648426 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:01:19.650078 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b41daae-5474-435e-bcc0-a1a5216c0e23 None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:01:19.650588 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b41daae-5474-435e-bcc0-a1a5216c0e23 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:01:19.651632 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b41daae-5474-435e-bcc0-a1a5216c0e23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:01:19.678184 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-4b41daae-5474-435e-bcc0-a1a5216c0e23 None None] MFA Rules not processed for user `ae863915635746d1ac19970949de4722`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:01:19.679716 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-4b41daae-5474-435e-bcc0-a1a5216c0e23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:01:19.721917 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55457ff-f502-48a3-a106-67a26c621942 None None] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:01:19.737413 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:01:19.784592 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9722d773-52f5-48b6-887a-3c023e420846 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:01:19.785211 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9722d773-52f5-48b6-887a-3c023e420846 None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:01:19.785519 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9722d773-52f5-48b6-887a-3c023e420846 None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:01:19.785794 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9722d773-52f5-48b6-887a-3c023e420846 None admin] PATH_INFO: `/v3/roles` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:01:19.786467 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9722d773-52f5-48b6-887a-3c023e420846 None admin] RBAC: Adding query filter params (name=service) {{(pid=81765) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:01:19.786773 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9722d773-52f5-48b6-887a-3c023e420846 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:01:19.788146 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9722d773-52f5-48b6-887a-3c023e420846 None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:01:19.801970 dv-cinder-862365-1-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 185/368] 10.222.0.23 () {56 vars in 1103 bytes} [Fri Oct 28 19:01:19 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:01:19.805618 dv-cinder-862365-1-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 184/369] 10.222.0.23 () {58 vars in 1024 bytes} [Fri Oct 28 19:01:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 28 19:01:19.810346 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9722d773-52f5-48b6-887a-3c023e420846 None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:01:19.971565 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9722d773-52f5-48b6-887a-3c023e420846 None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:01:19.998329 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b41daae-5474-435e-bcc0-a1a5216c0e23 None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:01:20.008858 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:01:20.024223 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67603a3e-46eb-41e8-9222-836b790b850f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:01:20.027392 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67603a3e-46eb-41e8-9222-836b790b850f None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:01:20.027392 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67603a3e-46eb-41e8-9222-836b790b850f None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:01:20.027392 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67603a3e-46eb-41e8-9222-836b790b850f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:01:20.046383 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67603a3e-46eb-41e8-9222-836b790b850f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:01:20.048092 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67603a3e-46eb-41e8-9222-836b790b850f None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:01:20.076002 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application [None req-67603a3e-46eb-41e8-9222-836b790b850f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 19:01:20.076002 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 19:01:20.076002 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 19:01:20.076002 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 19:01:20.076002 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 19:01:20.076002 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 19:01:20.076002 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 19:01:20.076002 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 19:01:20.076002 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 19:01:20.076002 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 19:01:20.076002 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 19:01:20.076002 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 19:01:20.076002 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 28 19:01:20.076002 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 28 19:01:20.076002 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 28 19:01:20.076002 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 28 19:01:20.076957 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 19:01:20.076957 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 19:01:20.076957 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 19:01:20.076957 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 19:01:20.076957 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 19:01:20.076957 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 19:01:20.076957 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 19:01:20.076957 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application with Lock( Oct 28 19:01:20.076957 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 19:01:20.076957 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._enter() Oct 28 19:01:20.076957 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 19:01:20.076957 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 19:01:20.076957 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 19:01:20.076957 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.creator() Oct 28 19:01:20.076957 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 19:01:20.076957 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application created_value = creator( Oct 28 19:01:20.076957 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 28 19:01:20.077849 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 28 19:01:20.077849 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 19:01:20.077849 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application Oct 28 19:01:20.085765 dv-cinder-862365-1-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 186/370] 10.222.0.23 () {56 vars in 1108 bytes} [Fri Oct 28 19:01:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 276 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 19:01:20.094345 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67603a3e-46eb-41e8-9222-836b790b850f None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:01:20.111580 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b41daae-5474-435e-bcc0-a1a5216c0e23 None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:01:20.148725 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4186058-7216-41f7-af22-246b25dd1b17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:01:20.149794 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4186058-7216-41f7-af22-246b25dd1b17 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:01:20.150414 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4186058-7216-41f7-af22-246b25dd1b17 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:01:20.150917 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4186058-7216-41f7-af22-246b25dd1b17 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:01:20.161479 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4186058-7216-41f7-af22-246b25dd1b17 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 19:01:20.166805 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application [None req-f4186058-7216-41f7-af22-246b25dd1b17 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 28 19:01:20.166805 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 19:01:20.166805 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 19:01:20.166805 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 19:01:20.166805 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 19:01:20.166805 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 19:01:20.166805 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 19:01:20.166805 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 19:01:20.166805 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 19:01:20.166805 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 19:01:20.166805 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 19:01:20.166805 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 19:01:20.166805 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 28 19:01:20.166805 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 28 19:01:20.166805 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 28 19:01:20.166805 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 28 19:01:20.167661 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 28 19:01:20.167661 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 28 19:01:20.167661 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 28 19:01:20.167661 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 28 19:01:20.167661 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 19:01:20.167661 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 19:01:20.167661 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 19:01:20.167661 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 19:01:20.167661 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 19:01:20.167661 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 19:01:20.167661 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 19:01:20.167661 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application with Lock( Oct 28 19:01:20.167661 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 19:01:20.167661 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._enter() Oct 28 19:01:20.167661 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 19:01:20.167661 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 19:01:20.168436 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 19:01:20.168436 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.creator() Oct 28 19:01:20.168436 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 19:01:20.168436 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application created_value = creator( Oct 28 19:01:20.168436 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 28 19:01:20.168436 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 28 19:01:20.168436 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 28 19:01:20.168436 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 28 19:01:20.168436 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 28 19:01:20.168436 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 28 19:01:20.168436 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 28 19:01:20.168436 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Oct 28 19:01:20.175751 dv-cinder-862365-1-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 185/371] 10.222.0.23 () {56 vars in 1102 bytes} [Fri Oct 28 19:01:19 2022] GET /identity/v3/roles/service => generated 85 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 28 19:01:20.177129 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4186058-7216-41f7-af22-246b25dd1b17 None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:01:20.209082 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:01:20.276779 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67603a3e-46eb-41e8-9222-836b790b850f None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:01:20.304965 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4186058-7216-41f7-af22-246b25dd1b17 None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:01:20.317560 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b048e2fb-f0bc-4245-bc94-a6217cb021f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:01:20.318172 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b048e2fb-f0bc-4245-bc94-a6217cb021f6 None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:01:20.318451 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b048e2fb-f0bc-4245-bc94-a6217cb021f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:01:20.318720 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b048e2fb-f0bc-4245-bc94-a6217cb021f6 None admin] PATH_INFO: `/v3/domains` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:01:20.319359 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b048e2fb-f0bc-4245-bc94-a6217cb021f6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81765) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:01:20.319659 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b048e2fb-f0bc-4245-bc94-a6217cb021f6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:01:20.321024 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b048e2fb-f0bc-4245-bc94-a6217cb021f6 None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:01:20.339779 dv-cinder-862365-1-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 187/372] 10.222.0.23 () {56 vars in 1109 bytes} [Fri Oct 28 19:01:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:01:20.340636 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b048e2fb-f0bc-4245-bc94-a6217cb021f6 None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:01:20.345506 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0a1423-b649-4066-a777-14cf4100a835 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:01:20.346368 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0a1423-b649-4066-a777-14cf4100a835 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:01:20.346871 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0a1423-b649-4066-a777-14cf4100a835 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:01:20.347347 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0a1423-b649-4066-a777-14cf4100a835 None admin] PATH_INFO: `/v3/roles` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:01:20.348202 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0a1423-b649-4066-a777-14cf4100a835 None admin] RBAC: Adding query filter params (name=service) {{(pid=81766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:01:20.348712 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0a1423-b649-4066-a777-14cf4100a835 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:01:20.350292 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0a1423-b649-4066-a777-14cf4100a835 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:01:20.364457 dv-cinder-862365-1-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 186/373] 10.222.0.23 () {56 vars in 1103 bytes} [Fri Oct 28 19:01:20 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:01:20.365703 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0a1423-b649-4066-a777-14cf4100a835 None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:01:20.383178 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:01:20.448900 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b048e2fb-f0bc-4245-bc94-a6217cb021f6 None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:01:20.460530 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:01:20.472384 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0a1423-b649-4066-a777-14cf4100a835 None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:01:20.485196 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71b5858-b3fd-402a-9e0f-0a30117d960a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:01:20.485862 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71b5858-b3fd-402a-9e0f-0a30117d960a None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:01:20.486130 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71b5858-b3fd-402a-9e0f-0a30117d960a None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:01:20.486397 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71b5858-b3fd-402a-9e0f-0a30117d960a None admin] PATH_INFO: `/v3/roles/service` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:01:20.497388 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71b5858-b3fd-402a-9e0f-0a30117d960a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 19:01:20.502663 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application [None req-a71b5858-b3fd-402a-9e0f-0a30117d960a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 28 19:01:20.502663 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 19:01:20.502663 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 19:01:20.502663 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 19:01:20.502663 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 19:01:20.502663 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 19:01:20.502663 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 19:01:20.502663 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 19:01:20.502663 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 19:01:20.502663 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 19:01:20.502663 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 19:01:20.502663 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 19:01:20.502663 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 28 19:01:20.502663 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 28 19:01:20.502663 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 28 19:01:20.502663 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 28 19:01:20.503553 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 28 19:01:20.503553 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 28 19:01:20.503553 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 28 19:01:20.503553 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 28 19:01:20.503553 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 19:01:20.503553 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 19:01:20.503553 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 19:01:20.503553 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 19:01:20.503553 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 19:01:20.503553 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 19:01:20.503553 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 19:01:20.503553 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application with Lock( Oct 28 19:01:20.503553 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 19:01:20.503553 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._enter() Oct 28 19:01:20.503553 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 19:01:20.503553 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 19:01:20.504359 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 19:01:20.504359 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.creator() Oct 28 19:01:20.504359 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 19:01:20.504359 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application created_value = creator( Oct 28 19:01:20.504359 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 28 19:01:20.504359 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 28 19:01:20.504359 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 28 19:01:20.504359 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 28 19:01:20.504359 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 28 19:01:20.504359 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 28 19:01:20.504359 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 28 19:01:20.504359 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application Oct 28 19:01:20.504359 dv-cinder-862365-1-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 188/374] 10.222.0.23 () {56 vars in 1102 bytes} [Fri Oct 28 19:01:20 2022] GET /identity/v3/roles/service => generated 85 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 19:01:20.505031 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71b5858-b3fd-402a-9e0f-0a30117d960a None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:01:20.514388 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d5dbc3-c9da-41c6-8512-3489a73774ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:01:20.515028 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d5dbc3-c9da-41c6-8512-3489a73774ff None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:01:20.515300 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d5dbc3-c9da-41c6-8512-3489a73774ff None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:01:20.515876 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d5dbc3-c9da-41c6-8512-3489a73774ff None admin] PATH_INFO: `/v3/users/nova` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:01:20.524038 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d5dbc3-c9da-41c6-8512-3489a73774ff None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:01:20.525761 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d5dbc3-c9da-41c6-8512-3489a73774ff None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:01:20.540384 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application [None req-f4d5dbc3-c9da-41c6-8512-3489a73774ff None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 28 19:01:20.540384 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 19:01:20.540384 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 19:01:20.540384 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 19:01:20.540384 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 19:01:20.540384 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 19:01:20.540384 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 19:01:20.540384 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 19:01:20.540384 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 19:01:20.540384 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 19:01:20.540384 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 19:01:20.540384 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 19:01:20.540384 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 28 19:01:20.540384 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 28 19:01:20.540384 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 28 19:01:20.540384 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 28 19:01:20.542069 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 19:01:20.542069 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 19:01:20.542069 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 28 19:01:20.542069 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 28 19:01:20.542069 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 28 19:01:20.542069 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 28 19:01:20.542069 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 19:01:20.542069 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 19:01:20.542069 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 19:01:20.542069 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 19:01:20.542069 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 19:01:20.542069 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application with Lock( Oct 28 19:01:20.542069 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 19:01:20.542069 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._enter() Oct 28 19:01:20.542069 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 19:01:20.542069 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 19:01:20.542069 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 19:01:20.542069 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.creator() Oct 28 19:01:20.542999 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 19:01:20.542999 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application created_value = creator( Oct 28 19:01:20.542999 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 28 19:01:20.542999 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 28 19:01:20.542999 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 28 19:01:20.542999 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 28 19:01:20.542999 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 28 19:01:20.542999 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 28 19:01:20.542999 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 28 19:01:20.542999 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Oct 28 19:01:20.542999 dv-cinder-862365-1-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 187/375] 10.222.0.23 () {56 vars in 1093 bytes} [Fri Oct 28 19:01:20 2022] GET /identity/v3/users/nova => generated 82 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 19:01:20.543594 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8305b3c0-d8c0-4718-8893-d0f10586f107 None None] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:01:20.543594 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8305b3c0-d8c0-4718-8893-d0f10586f107 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:01:20.543721 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8305b3c0-d8c0-4718-8893-d0f10586f107 None None] PATH_INFO: `/` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:01:20.544993 dv-cinder-862365-1-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 188/376] 10.222.0.23 () {54 vars in 927 bytes} [Fri Oct 28 19:01:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 19:01:20.549525 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8305b3c0-d8c0-4718-8893-d0f10586f107 None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:01:20.613936 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:01:20.618338 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71b5858-b3fd-402a-9e0f-0a30117d960a None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:01:20.653778 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433b43a5-083a-47f2-974f-05f828b459ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:01:20.654413 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433b43a5-083a-47f2-974f-05f828b459ad None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:01:20.654697 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433b43a5-083a-47f2-974f-05f828b459ad None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:01:20.654974 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433b43a5-083a-47f2-974f-05f828b459ad None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:01:20.658473 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8305b3c0-d8c0-4718-8893-d0f10586f107 None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:01:20.665145 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433b43a5-083a-47f2-974f-05f828b459ad None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:01:20.667168 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433b43a5-083a-47f2-974f-05f828b459ad None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:01:20.682968 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application [None req-433b43a5-083a-47f2-974f-05f828b459ad None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 19:01:20.682968 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 19:01:20.682968 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 19:01:20.682968 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 19:01:20.682968 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 19:01:20.682968 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 19:01:20.682968 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 19:01:20.682968 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 19:01:20.682968 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 19:01:20.682968 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 19:01:20.682968 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 19:01:20.682968 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 19:01:20.682968 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 28 19:01:20.682968 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 28 19:01:20.682968 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 28 19:01:20.682968 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 28 19:01:20.683965 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 19:01:20.683965 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 19:01:20.683965 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 19:01:20.683965 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 19:01:20.683965 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 19:01:20.683965 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 19:01:20.683965 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 19:01:20.683965 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application with Lock( Oct 28 19:01:20.683965 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 19:01:20.683965 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._enter() Oct 28 19:01:20.683965 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 19:01:20.683965 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 19:01:20.683965 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 19:01:20.683965 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.creator() Oct 28 19:01:20.683965 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 19:01:20.683965 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application created_value = creator( Oct 28 19:01:20.683965 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 28 19:01:20.684803 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 28 19:01:20.684803 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 19:01:20.684803 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application Oct 28 19:01:20.684803 dv-cinder-862365-1-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 189/377] 10.222.0.23 () {56 vars in 1108 bytes} [Fri Oct 28 19:01:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 19:01:20.690943 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433b43a5-083a-47f2-974f-05f828b459ad None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:01:20.696513 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395b03bc-36e1-4ede-b76d-b49f5885c05a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:01:20.697145 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395b03bc-36e1-4ede-b76d-b49f5885c05a None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:01:20.697467 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395b03bc-36e1-4ede-b76d-b49f5885c05a None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:01:20.697772 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395b03bc-36e1-4ede-b76d-b49f5885c05a None admin] PATH_INFO: `/v3/roles` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:01:20.698461 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395b03bc-36e1-4ede-b76d-b49f5885c05a None admin] RBAC: Adding query filter params (name=service) {{(pid=81766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:01:20.698774 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395b03bc-36e1-4ede-b76d-b49f5885c05a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:01:20.700212 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395b03bc-36e1-4ede-b76d-b49f5885c05a None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:01:20.709164 dv-cinder-862365-1-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 189/378] 10.222.0.23 () {56 vars in 1103 bytes} [Fri Oct 28 19:01:20 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:01:20.709164 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55c1bf6-9043-413b-bf05-b2b7f4270097 None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:01:20.709164 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55c1bf6-9043-413b-bf05-b2b7f4270097 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:01:20.709164 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55c1bf6-9043-413b-bf05-b2b7f4270097 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:01:20.730770 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-b55c1bf6-9043-413b-bf05-b2b7f4270097 None None] MFA Rules not processed for user `ae863915635746d1ac19970949de4722`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:01:20.732433 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-b55c1bf6-9043-413b-bf05-b2b7f4270097 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:01:20.740600 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:01:20.813457 dv-cinder-862365-1-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 190/379] 10.222.0.23 () {58 vars in 1024 bytes} [Fri Oct 28 19:01:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 28 19:01:20.813457 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55c1bf6-9043-413b-bf05-b2b7f4270097 None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:01:20.818388 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433b43a5-083a-47f2-974f-05f828b459ad None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:01:20.860522 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39911d8-d68f-451f-8c34-81001f4833c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:01:20.861126 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39911d8-d68f-451f-8c34-81001f4833c0 None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:01:20.861436 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39911d8-d68f-451f-8c34-81001f4833c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:01:20.861712 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39911d8-d68f-451f-8c34-81001f4833c0 None admin] PATH_INFO: `/v3/users` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:01:20.862602 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39911d8-d68f-451f-8c34-81001f4833c0 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81765) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:01:20.862745 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39911d8-d68f-451f-8c34-81001f4833c0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:01:20.864149 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39911d8-d68f-451f-8c34-81001f4833c0 None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:01:20.905176 dv-cinder-862365-1-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 190/380] 10.222.0.23 () {56 vars in 1133 bytes} [Fri Oct 28 19:01:20 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:01:20.905942 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39911d8-d68f-451f-8c34-81001f4833c0 None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:01:20.912583 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55c1bf6-9043-413b-bf05-b2b7f4270097 None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:01:20.917954 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:01:20.948538 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61dbe1ec-200d-4dff-84ad-44f80a190a29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:01:20.949610 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61dbe1ec-200d-4dff-84ad-44f80a190a29 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:01:20.949893 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61dbe1ec-200d-4dff-84ad-44f80a190a29 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:01:20.950166 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61dbe1ec-200d-4dff-84ad-44f80a190a29 None admin] PATH_INFO: `/v3/domains` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:01:20.951160 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61dbe1ec-200d-4dff-84ad-44f80a190a29 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:01:20.951467 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61dbe1ec-200d-4dff-84ad-44f80a190a29 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:01:20.953413 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61dbe1ec-200d-4dff-84ad-44f80a190a29 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:01:20.966681 dv-cinder-862365-1-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 191/381] 10.222.0.23 () {56 vars in 1109 bytes} [Fri Oct 28 19:01:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:01:20.967942 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbcb0b5-e726-4781-a2ef-17e6466e5cc4 None None] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:01:20.968224 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbcb0b5-e726-4781-a2ef-17e6466e5cc4 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:01:20.968494 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbcb0b5-e726-4781-a2ef-17e6466e5cc4 None None] PATH_INFO: `/` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:01:20.969858 dv-cinder-862365-1-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 192/382] 10.222.0.23 () {54 vars in 927 bytes} [Fri Oct 28 19:01:20 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 19:01:20.970436 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbcb0b5-e726-4781-a2ef-17e6466e5cc4 None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:01:20.975413 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:01:21.020604 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39911d8-d68f-451f-8c34-81001f4833c0 None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:01:21.057773 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9674c2-3527-46bc-a78c-84b96e35d6c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:01:21.058655 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9674c2-3527-46bc-a78c-84b96e35d6c3 None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:01:21.059067 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9674c2-3527-46bc-a78c-84b96e35d6c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:01:21.059502 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9674c2-3527-46bc-a78c-84b96e35d6c3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:01:21.070440 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9674c2-3527-46bc-a78c-84b96e35d6c3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:01:21.072057 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9674c2-3527-46bc-a78c-84b96e35d6c3 None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:01:21.073312 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbcb0b5-e726-4781-a2ef-17e6466e5cc4 None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:01:21.086963 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application [None req-1f9674c2-3527-46bc-a78c-84b96e35d6c3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 19:01:21.086963 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 19:01:21.086963 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 19:01:21.086963 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 19:01:21.086963 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 19:01:21.086963 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 19:01:21.086963 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 19:01:21.086963 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 19:01:21.086963 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 19:01:21.086963 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 19:01:21.086963 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 19:01:21.086963 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 19:01:21.086963 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 28 19:01:21.086963 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 28 19:01:21.086963 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 28 19:01:21.086963 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 28 19:01:21.087999 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 19:01:21.087999 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 19:01:21.087999 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 19:01:21.087999 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 19:01:21.087999 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 19:01:21.087999 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 19:01:21.087999 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 19:01:21.087999 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application with Lock( Oct 28 19:01:21.087999 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 19:01:21.087999 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._enter() Oct 28 19:01:21.087999 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 19:01:21.087999 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 19:01:21.087999 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 19:01:21.087999 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.creator() Oct 28 19:01:21.087999 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 19:01:21.087999 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application created_value = creator( Oct 28 19:01:21.087999 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 28 19:01:21.089394 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 28 19:01:21.089394 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 19:01:21.089394 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application Oct 28 19:01:21.089394 dv-cinder-862365-1-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 191/383] 10.222.0.23 () {56 vars in 1108 bytes} [Fri Oct 28 19:01:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 19:01:21.089394 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9674c2-3527-46bc-a78c-84b96e35d6c3 None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:01:21.108356 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38701973-7e7b-43f9-b362-00d8c5636c1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:01:21.108977 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38701973-7e7b-43f9-b362-00d8c5636c1d None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:01:21.109252 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38701973-7e7b-43f9-b362-00d8c5636c1d None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:01:21.109551 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38701973-7e7b-43f9-b362-00d8c5636c1d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:01:21.119872 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38701973-7e7b-43f9-b362-00d8c5636c1d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:01:21.121455 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38701973-7e7b-43f9-b362-00d8c5636c1d None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:01:21.136042 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application [None req-38701973-7e7b-43f9-b362-00d8c5636c1d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 19:01:21.136042 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 19:01:21.136042 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 19:01:21.136042 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 19:01:21.136042 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 19:01:21.136042 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 19:01:21.136042 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 19:01:21.136042 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 19:01:21.136042 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 19:01:21.136042 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 19:01:21.136042 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 19:01:21.136042 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 19:01:21.136042 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 28 19:01:21.136042 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 28 19:01:21.136042 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 28 19:01:21.136042 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 28 19:01:21.137011 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 19:01:21.137011 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 19:01:21.137011 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 19:01:21.137011 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 19:01:21.137011 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 19:01:21.137011 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 19:01:21.137011 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 19:01:21.137011 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application with Lock( Oct 28 19:01:21.137011 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 19:01:21.137011 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._enter() Oct 28 19:01:21.137011 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 19:01:21.137011 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 19:01:21.137011 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 19:01:21.137011 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.creator() Oct 28 19:01:21.137011 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 19:01:21.137011 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application created_value = creator( Oct 28 19:01:21.137011 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 28 19:01:21.137881 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 28 19:01:21.137881 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 19:01:21.137881 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Oct 28 19:01:21.137881 dv-cinder-862365-1-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 193/384] 10.222.0.23 () {56 vars in 1108 bytes} [Fri Oct 28 19:01:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 19:01:21.138284 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de94f62-32f4-4b0c-99f6-00eb0146cec0 None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:01:21.138571 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de94f62-32f4-4b0c-99f6-00eb0146cec0 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:01:21.138849 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de94f62-32f4-4b0c-99f6-00eb0146cec0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:01:21.148513 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:01:21.156542 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-4de94f62-32f4-4b0c-99f6-00eb0146cec0 None None] MFA Rules not processed for user `ae863915635746d1ac19970949de4722`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:01:21.157804 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-4de94f62-32f4-4b0c-99f6-00eb0146cec0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:01:21.188300 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9674c2-3527-46bc-a78c-84b96e35d6c3 None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:01:21.206925 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:01:21.221473 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de10fdaa-f2a4-445f-be74-5b822fa0cd1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:01:21.222095 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de10fdaa-f2a4-445f-be74-5b822fa0cd1f None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:01:21.222374 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de10fdaa-f2a4-445f-be74-5b822fa0cd1f None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:01:21.222645 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de10fdaa-f2a4-445f-be74-5b822fa0cd1f None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:01:21.224636 dv-cinder-862365-1-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 194/385] 10.222.0.23 () {58 vars in 1024 bytes} [Fri Oct 28 19:01:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 28 19:01:21.225477 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de94f62-32f4-4b0c-99f6-00eb0146cec0 None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:01:21.237118 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de10fdaa-f2a4-445f-be74-5b822fa0cd1f None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:01:21.238709 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de10fdaa-f2a4-445f-be74-5b822fa0cd1f None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:01:21.251148 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application [None req-de10fdaa-f2a4-445f-be74-5b822fa0cd1f None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Oct 28 19:01:21.251148 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 19:01:21.251148 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 19:01:21.251148 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 19:01:21.251148 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 19:01:21.251148 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 19:01:21.251148 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 19:01:21.251148 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 19:01:21.251148 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 19:01:21.251148 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 19:01:21.251148 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 19:01:21.251148 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 19:01:21.251148 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 28 19:01:21.251148 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 28 19:01:21.251148 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 28 19:01:21.251148 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 28 19:01:21.252068 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 19:01:21.252068 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 19:01:21.252068 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 28 19:01:21.252068 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 28 19:01:21.252068 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 28 19:01:21.252068 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 28 19:01:21.252068 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 19:01:21.252068 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 19:01:21.252068 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 19:01:21.252068 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 19:01:21.252068 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 19:01:21.252068 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application with Lock( Oct 28 19:01:21.252068 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 19:01:21.252068 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._enter() Oct 28 19:01:21.252068 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 19:01:21.252068 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 19:01:21.252068 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 19:01:21.252068 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.creator() Oct 28 19:01:21.253487 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 19:01:21.253487 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application created_value = creator( Oct 28 19:01:21.253487 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 28 19:01:21.253487 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 28 19:01:21.253487 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 28 19:01:21.253487 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 28 19:01:21.253487 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 28 19:01:21.253487 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 28 19:01:21.253487 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Oct 28 19:01:21.253487 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application Oct 28 19:01:21.253487 dv-cinder-862365-1-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 192/386] 10.222.0.23 () {56 vars in 1099 bytes} [Fri Oct 28 19:01:21 2022] GET /identity/v3/users/cinder => generated 84 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 19:01:21.253487 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de10fdaa-f2a4-445f-be74-5b822fa0cd1f None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:01:21.333498 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de94f62-32f4-4b0c-99f6-00eb0146cec0 None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:01:21.362776 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de10fdaa-f2a4-445f-be74-5b822fa0cd1f None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:01:21.368880 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95dd70a-b777-49d5-b460-3c40c0b940a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:01:21.369559 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95dd70a-b777-49d5-b460-3c40c0b940a2 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:01:21.370813 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95dd70a-b777-49d5-b460-3c40c0b940a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:01:21.371095 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95dd70a-b777-49d5-b460-3c40c0b940a2 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:01:21.382321 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95dd70a-b777-49d5-b460-3c40c0b940a2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 19:01:21.382927 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:01:21.388602 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application [None req-e95dd70a-b777-49d5-b460-3c40c0b940a2 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 28 19:01:21.388602 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 19:01:21.388602 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 19:01:21.388602 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 19:01:21.388602 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 19:01:21.388602 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 19:01:21.388602 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 19:01:21.388602 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 19:01:21.388602 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 19:01:21.388602 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 19:01:21.388602 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 19:01:21.388602 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 19:01:21.388602 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 28 19:01:21.388602 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 28 19:01:21.388602 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 28 19:01:21.388602 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 28 19:01:21.389538 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 28 19:01:21.389538 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 28 19:01:21.389538 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 28 19:01:21.389538 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 28 19:01:21.389538 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 19:01:21.389538 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 19:01:21.389538 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 19:01:21.389538 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 19:01:21.389538 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 19:01:21.389538 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 19:01:21.389538 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 19:01:21.389538 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application with Lock( Oct 28 19:01:21.389538 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 19:01:21.389538 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._enter() Oct 28 19:01:21.389538 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 19:01:21.389538 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 19:01:21.390321 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 19:01:21.390321 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.creator() Oct 28 19:01:21.390321 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 19:01:21.390321 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application created_value = creator( Oct 28 19:01:21.390321 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 28 19:01:21.390321 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 28 19:01:21.390321 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 28 19:01:21.390321 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 28 19:01:21.390321 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 28 19:01:21.390321 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 28 19:01:21.390321 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 28 19:01:21.390321 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Oct 28 19:01:21.390321 dv-cinder-862365-1-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 195/387] 10.222.0.23 () {56 vars in 1102 bytes} [Fri Oct 28 19:01:21 2022] GET /identity/v3/roles/service => generated 85 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 19:01:21.390970 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95dd70a-b777-49d5-b460-3c40c0b940a2 None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:01:21.403332 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b7533e-984a-4440-9e54-e24ff478830c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:01:21.403942 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b7533e-984a-4440-9e54-e24ff478830c None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:01:21.404226 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b7533e-984a-4440-9e54-e24ff478830c None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:01:21.404501 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b7533e-984a-4440-9e54-e24ff478830c None admin] PATH_INFO: `/v3/domains` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:01:21.405145 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b7533e-984a-4440-9e54-e24ff478830c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81765) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:01:21.405483 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b7533e-984a-4440-9e54-e24ff478830c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:01:21.407012 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b7533e-984a-4440-9e54-e24ff478830c None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:01:21.423226 dv-cinder-862365-1-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 193/388] 10.222.0.23 () {56 vars in 1109 bytes} [Fri Oct 28 19:01:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:01:21.424362 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b7533e-984a-4440-9e54-e24ff478830c None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:01:21.441024 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:01:21.496292 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95dd70a-b777-49d5-b460-3c40c0b940a2 None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:01:21.530567 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00146ac3-378e-40e9-aa90-2b11ecf52c39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:01:21.531089 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b7533e-984a-4440-9e54-e24ff478830c None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:01:21.531209 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00146ac3-378e-40e9-aa90-2b11ecf52c39 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:01:21.531437 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00146ac3-378e-40e9-aa90-2b11ecf52c39 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:01:21.531713 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00146ac3-378e-40e9-aa90-2b11ecf52c39 None admin] PATH_INFO: `/v3/domains` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:01:21.532356 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00146ac3-378e-40e9-aa90-2b11ecf52c39 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:01:21.532665 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00146ac3-378e-40e9-aa90-2b11ecf52c39 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:01:21.534061 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00146ac3-378e-40e9-aa90-2b11ecf52c39 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:01:21.546518 dv-cinder-862365-1-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 196/389] 10.222.0.23 () {56 vars in 1109 bytes} [Fri Oct 28 19:01:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:01:21.547863 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00146ac3-378e-40e9-aa90-2b11ecf52c39 None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:01:21.569935 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff2a84d-38e2-4476-a3bc-1db892f18b53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:01:21.570531 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff2a84d-38e2-4476-a3bc-1db892f18b53 None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:01:21.570807 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff2a84d-38e2-4476-a3bc-1db892f18b53 None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:01:21.571075 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff2a84d-38e2-4476-a3bc-1db892f18b53 None admin] PATH_INFO: `/v3/users` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:01:21.571797 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff2a84d-38e2-4476-a3bc-1db892f18b53 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81765) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:01:21.572104 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff2a84d-38e2-4476-a3bc-1db892f18b53 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:01:21.573595 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff2a84d-38e2-4476-a3bc-1db892f18b53 None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:01:21.590938 dv-cinder-862365-1-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 194/390] 10.222.0.23 () {56 vars in 1137 bytes} [Fri Oct 28 19:01:21 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:01:21.591764 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff2a84d-38e2-4476-a3bc-1db892f18b53 None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:01:21.630195 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:01:21.647391 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00146ac3-378e-40e9-aa90-2b11ecf52c39 None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:01:21.649683 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:01:21.682449 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3188f95-517c-4c97-aed3-5886d69ff39b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:01:21.683347 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3188f95-517c-4c97-aed3-5886d69ff39b None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:01:21.683627 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3188f95-517c-4c97-aed3-5886d69ff39b None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:01:21.683902 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3188f95-517c-4c97-aed3-5886d69ff39b None admin] PATH_INFO: `/v3/roles` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:01:21.684558 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3188f95-517c-4c97-aed3-5886d69ff39b None admin] RBAC: Adding query filter params (name=service) {{(pid=81766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:01:21.684863 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3188f95-517c-4c97-aed3-5886d69ff39b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:01:21.686256 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3188f95-517c-4c97-aed3-5886d69ff39b None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:01:21.694152 dv-cinder-862365-1-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 197/391] 10.222.0.23 () {56 vars in 1103 bytes} [Fri Oct 28 19:01:21 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:01:21.694937 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3188f95-517c-4c97-aed3-5886d69ff39b None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:01:21.701591 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff2a84d-38e2-4476-a3bc-1db892f18b53 None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:01:21.736286 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5d200b-c41b-4018-b507-c5c2b39b1ec2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:01:21.736914 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5d200b-c41b-4018-b507-c5c2b39b1ec2 None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:01:21.737198 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5d200b-c41b-4018-b507-c5c2b39b1ec2 None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:01:21.737504 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5d200b-c41b-4018-b507-c5c2b39b1ec2 None admin] PATH_INFO: `/v3/users/glance` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:01:21.744356 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5d200b-c41b-4018-b507-c5c2b39b1ec2 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:01:21.745831 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5d200b-c41b-4018-b507-c5c2b39b1ec2 None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:01:21.757298 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application [None req-bc5d200b-c41b-4018-b507-c5c2b39b1ec2 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Oct 28 19:01:21.757298 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 19:01:21.757298 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 19:01:21.757298 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 19:01:21.757298 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 19:01:21.757298 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 19:01:21.757298 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 19:01:21.757298 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 19:01:21.757298 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 19:01:21.757298 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 19:01:21.757298 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 19:01:21.757298 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 19:01:21.757298 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 28 19:01:21.757298 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 28 19:01:21.757298 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 28 19:01:21.757298 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 28 19:01:21.758346 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 19:01:21.758346 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 19:01:21.758346 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 28 19:01:21.758346 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 28 19:01:21.758346 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 28 19:01:21.758346 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 28 19:01:21.758346 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 19:01:21.758346 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 19:01:21.758346 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 19:01:21.758346 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 19:01:21.758346 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 19:01:21.758346 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application with Lock( Oct 28 19:01:21.758346 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 19:01:21.758346 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._enter() Oct 28 19:01:21.758346 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 19:01:21.758346 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 19:01:21.758346 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 19:01:21.758346 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.creator() Oct 28 19:01:21.759233 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 19:01:21.759233 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application created_value = creator( Oct 28 19:01:21.759233 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 28 19:01:21.759233 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 28 19:01:21.759233 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 28 19:01:21.759233 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 28 19:01:21.759233 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 28 19:01:21.759233 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 28 19:01:21.759233 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Oct 28 19:01:21.759233 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application Oct 28 19:01:21.759233 dv-cinder-862365-1-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 195/392] 10.222.0.23 () {56 vars in 1099 bytes} [Fri Oct 28 19:01:21 2022] GET /identity/v3/users/glance => generated 84 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 19:01:21.759233 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5d200b-c41b-4018-b507-c5c2b39b1ec2 None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:01:21.796117 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3188f95-517c-4c97-aed3-5886d69ff39b None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:01:21.828346 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8cb449-7c08-484a-a74c-ab015f6afff5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:01:21.829065 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8cb449-7c08-484a-a74c-ab015f6afff5 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:01:21.829469 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8cb449-7c08-484a-a74c-ab015f6afff5 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:01:21.829817 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8cb449-7c08-484a-a74c-ab015f6afff5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:01:21.841757 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8cb449-7c08-484a-a74c-ab015f6afff5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:01:21.843542 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8cb449-7c08-484a-a74c-ab015f6afff5 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:01:21.858349 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application [None req-bb8cb449-7c08-484a-a74c-ab015f6afff5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 19:01:21.858349 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 19:01:21.858349 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 19:01:21.858349 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 19:01:21.858349 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 19:01:21.858349 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 19:01:21.858349 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 19:01:21.858349 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 19:01:21.858349 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 19:01:21.858349 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 19:01:21.858349 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 19:01:21.858349 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 19:01:21.858349 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 28 19:01:21.858349 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 28 19:01:21.858349 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 28 19:01:21.858349 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 28 19:01:21.859477 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 19:01:21.859477 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 19:01:21.859477 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 19:01:21.859477 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 19:01:21.859477 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 19:01:21.859477 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 19:01:21.859477 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 19:01:21.859477 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application with Lock( Oct 28 19:01:21.859477 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 19:01:21.859477 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._enter() Oct 28 19:01:21.859477 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 19:01:21.859477 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 19:01:21.859477 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 19:01:21.859477 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.creator() Oct 28 19:01:21.859477 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 19:01:21.859477 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application created_value = creator( Oct 28 19:01:21.859477 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 28 19:01:21.860490 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 28 19:01:21.860490 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 19:01:21.860490 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Oct 28 19:01:21.860490 dv-cinder-862365-1-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 198/393] 10.222.0.23 () {56 vars in 1108 bytes} [Fri Oct 28 19:01:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 19:01:21.860490 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8cb449-7c08-484a-a74c-ab015f6afff5 None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:01:21.860989 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:01:21.864707 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5d200b-c41b-4018-b507-c5c2b39b1ec2 None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:01:21.882992 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:01:21.899315 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665dd48f-39d8-4499-809f-27eb45da5e95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:01:21.899942 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665dd48f-39d8-4499-809f-27eb45da5e95 None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:01:21.900221 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665dd48f-39d8-4499-809f-27eb45da5e95 None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:01:21.900495 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665dd48f-39d8-4499-809f-27eb45da5e95 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:01:21.907811 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-665dd48f-39d8-4499-809f-27eb45da5e95 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:01:21.909254 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-665dd48f-39d8-4499-809f-27eb45da5e95 None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:01:21.920989 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application [None req-665dd48f-39d8-4499-809f-27eb45da5e95 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 28 19:01:21.920989 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 19:01:21.920989 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 19:01:21.920989 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 19:01:21.920989 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 19:01:21.920989 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 19:01:21.920989 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 19:01:21.920989 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 19:01:21.920989 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 19:01:21.920989 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 19:01:21.920989 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 19:01:21.920989 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 19:01:21.920989 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 28 19:01:21.920989 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 28 19:01:21.920989 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 28 19:01:21.921936 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 28 19:01:21.921936 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 19:01:21.921936 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 19:01:21.921936 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 19:01:21.921936 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 19:01:21.921936 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 19:01:21.921936 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 19:01:21.921936 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 19:01:21.921936 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application with Lock( Oct 28 19:01:21.921936 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 19:01:21.921936 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._enter() Oct 28 19:01:21.921936 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 19:01:21.921936 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 19:01:21.921936 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 19:01:21.921936 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.creator() Oct 28 19:01:21.921936 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 19:01:21.921936 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application created_value = creator( Oct 28 19:01:21.922790 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 28 19:01:21.922790 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 28 19:01:21.922790 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 28 19:01:21.922790 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 28 19:01:21.922790 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 28 19:01:21.922790 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 28 19:01:21.922790 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 28 19:01:21.922790 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application Oct 28 19:01:21.922790 dv-cinder-862365-1-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 196/394] 10.222.0.23 () {56 vars in 1111 bytes} [Fri Oct 28 19:01:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 19:01:21.923310 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665dd48f-39d8-4499-809f-27eb45da5e95 None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:01:21.969305 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8cb449-7c08-484a-a74c-ab015f6afff5 None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:01:22.001191 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb00598-a503-43bd-a32f-f3a49b16c8ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:01:22.001842 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb00598-a503-43bd-a32f-f3a49b16c8ff None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:01:22.002124 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb00598-a503-43bd-a32f-f3a49b16c8ff None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:01:22.002396 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb00598-a503-43bd-a32f-f3a49b16c8ff None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:01:22.013129 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb00598-a503-43bd-a32f-f3a49b16c8ff None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:01:22.014577 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb00598-a503-43bd-a32f-f3a49b16c8ff None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:01:22.021838 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665dd48f-39d8-4499-809f-27eb45da5e95 None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:01:22.029297 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application [None req-0eb00598-a503-43bd-a32f-f3a49b16c8ff None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 19:01:22.029297 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 19:01:22.029297 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 19:01:22.029297 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 19:01:22.029297 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 19:01:22.029297 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 19:01:22.029297 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 19:01:22.029297 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 19:01:22.029297 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 19:01:22.029297 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 19:01:22.029297 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 19:01:22.029297 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 19:01:22.029297 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 28 19:01:22.029297 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 28 19:01:22.029297 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 28 19:01:22.029297 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 28 19:01:22.030403 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 19:01:22.030403 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 19:01:22.030403 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 19:01:22.030403 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 19:01:22.030403 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 19:01:22.030403 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 19:01:22.030403 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 19:01:22.030403 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application with Lock( Oct 28 19:01:22.030403 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 19:01:22.030403 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._enter() Oct 28 19:01:22.030403 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 19:01:22.030403 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 19:01:22.030403 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 19:01:22.030403 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.creator() Oct 28 19:01:22.030403 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 19:01:22.030403 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application created_value = creator( Oct 28 19:01:22.030403 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 28 19:01:22.031229 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 28 19:01:22.031229 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 19:01:22.031229 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Oct 28 19:01:22.031229 dv-cinder-862365-1-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 199/395] 10.222.0.23 () {56 vars in 1108 bytes} [Fri Oct 28 19:01:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 19:01:22.031229 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb00598-a503-43bd-a32f-f3a49b16c8ff None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:01:22.059604 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67fce56-0512-4c2f-9758-aecf6d756777 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:01:22.060234 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67fce56-0512-4c2f-9758-aecf6d756777 None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:01:22.060516 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67fce56-0512-4c2f-9758-aecf6d756777 None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:01:22.060800 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67fce56-0512-4c2f-9758-aecf6d756777 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:01:22.071295 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67fce56-0512-4c2f-9758-aecf6d756777 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:01:22.073246 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67fce56-0512-4c2f-9758-aecf6d756777 None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:01:22.088024 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application [None req-b67fce56-0512-4c2f-9758-aecf6d756777 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 19:01:22.088024 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 19:01:22.088024 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 19:01:22.088024 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 19:01:22.088024 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 19:01:22.088024 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 19:01:22.088024 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 19:01:22.088024 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 19:01:22.088024 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 19:01:22.088024 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 19:01:22.088024 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 19:01:22.088024 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 19:01:22.088024 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 28 19:01:22.088024 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 28 19:01:22.088024 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 28 19:01:22.088024 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 28 19:01:22.089679 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 19:01:22.089679 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 19:01:22.089679 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 19:01:22.089679 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 19:01:22.089679 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 19:01:22.089679 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 19:01:22.089679 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 19:01:22.089679 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application with Lock( Oct 28 19:01:22.089679 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 19:01:22.089679 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._enter() Oct 28 19:01:22.089679 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 19:01:22.089679 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 19:01:22.089679 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 19:01:22.089679 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.creator() Oct 28 19:01:22.089679 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 19:01:22.089679 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application created_value = creator( Oct 28 19:01:22.089679 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 28 19:01:22.090567 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 28 19:01:22.090567 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 19:01:22.090567 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application Oct 28 19:01:22.090567 dv-cinder-862365-1-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 197/396] 10.222.0.23 () {56 vars in 1108 bytes} [Fri Oct 28 19:01:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 19:01:22.090567 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67fce56-0512-4c2f-9758-aecf6d756777 None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:01:22.100680 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:01:22.102742 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:01:22.128737 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb00598-a503-43bd-a32f-f3a49b16c8ff None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:01:22.162776 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d553b145-d59e-47c0-aa7d-94b10604e5ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:01:22.163543 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d553b145-d59e-47c0-aa7d-94b10604e5ac None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:01:22.163820 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d553b145-d59e-47c0-aa7d-94b10604e5ac None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:01:22.164093 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d553b145-d59e-47c0-aa7d-94b10604e5ac None admin] PATH_INFO: `/v3/users` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:01:22.164813 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d553b145-d59e-47c0-aa7d-94b10604e5ac None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:01:22.165119 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d553b145-d59e-47c0-aa7d-94b10604e5ac None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:01:22.166600 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d553b145-d59e-47c0-aa7d-94b10604e5ac None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:01:22.186920 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67fce56-0512-4c2f-9758-aecf6d756777 None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:01:22.202722 dv-cinder-862365-1-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 200/397] 10.222.0.23 () {56 vars in 1137 bytes} [Fri Oct 28 19:01:22 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:01:22.203540 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d553b145-d59e-47c0-aa7d-94b10604e5ac None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:01:22.222644 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c6daf7-53ad-4008-88ac-91e83b4867ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:01:22.223249 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c6daf7-53ad-4008-88ac-91e83b4867ff None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:01:22.223529 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c6daf7-53ad-4008-88ac-91e83b4867ff None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:01:22.223803 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c6daf7-53ad-4008-88ac-91e83b4867ff None admin] PATH_INFO: `/v3/domains` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:01:22.224475 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c6daf7-53ad-4008-88ac-91e83b4867ff None admin] RBAC: Adding query filter params (name=Default) {{(pid=81765) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:01:22.224781 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c6daf7-53ad-4008-88ac-91e83b4867ff None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:01:22.226232 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c6daf7-53ad-4008-88ac-91e83b4867ff None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:01:22.237557 dv-cinder-862365-1-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 198/398] 10.222.0.23 () {56 vars in 1109 bytes} [Fri Oct 28 19:01:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:01:22.238331 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c6daf7-53ad-4008-88ac-91e83b4867ff None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:01:22.301251 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d553b145-d59e-47c0-aa7d-94b10604e5ac None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:01:22.306701 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:01:22.329423 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:01:22.337134 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac2b67d-6d79-4693-9f21-f548071bbe0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:01:22.337268 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c6daf7-53ad-4008-88ac-91e83b4867ff None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:01:22.337769 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac2b67d-6d79-4693-9f21-f548071bbe0d None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:01:22.338047 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac2b67d-6d79-4693-9f21-f548071bbe0d None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:01:22.338319 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac2b67d-6d79-4693-9f21-f548071bbe0d None admin] PATH_INFO: `/v3/projects` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:01:22.339024 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac2b67d-6d79-4693-9f21-f548071bbe0d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:01:22.339329 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac2b67d-6d79-4693-9f21-f548071bbe0d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:01:22.340831 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac2b67d-6d79-4693-9f21-f548071bbe0d None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:01:22.357994 dv-cinder-862365-1-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 201/399] 10.222.0.23 () {56 vars in 1148 bytes} [Fri Oct 28 19:01:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:01:22.358776 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac2b67d-6d79-4693-9f21-f548071bbe0d None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:01:22.371337 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209d3ecc-6a10-49b0-a0de-37f5fd71a774 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:01:22.371933 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209d3ecc-6a10-49b0-a0de-37f5fd71a774 None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:01:22.372212 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209d3ecc-6a10-49b0-a0de-37f5fd71a774 None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:01:22.372485 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209d3ecc-6a10-49b0-a0de-37f5fd71a774 None admin] PATH_INFO: `/v3/domains` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:01:22.373117 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209d3ecc-6a10-49b0-a0de-37f5fd71a774 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81765) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:01:22.373445 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209d3ecc-6a10-49b0-a0de-37f5fd71a774 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:01:22.374834 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209d3ecc-6a10-49b0-a0de-37f5fd71a774 None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:01:22.386259 dv-cinder-862365-1-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 199/400] 10.222.0.23 () {56 vars in 1109 bytes} [Fri Oct 28 19:01:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:01:22.387035 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209d3ecc-6a10-49b0-a0de-37f5fd71a774 None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:01:22.457817 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac2b67d-6d79-4693-9f21-f548071bbe0d None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:01:22.483689 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209d3ecc-6a10-49b0-a0de-37f5fd71a774 None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:01:22.491561 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2071ffea-b178-4fd7-a25d-aba269b98b8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:01:22.492172 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2071ffea-b178-4fd7-a25d-aba269b98b8c None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:01:22.492452 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2071ffea-b178-4fd7-a25d-aba269b98b8c None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:01:22.492725 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2071ffea-b178-4fd7-a25d-aba269b98b8c None admin] PATH_INFO: `/v3/domains` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:01:22.493382 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2071ffea-b178-4fd7-a25d-aba269b98b8c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:01:22.493708 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2071ffea-b178-4fd7-a25d-aba269b98b8c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:01:22.495577 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2071ffea-b178-4fd7-a25d-aba269b98b8c None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:01:22.506384 dv-cinder-862365-1-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 202/401] 10.222.0.23 () {56 vars in 1109 bytes} [Fri Oct 28 19:01:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:01:22.508046 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2071ffea-b178-4fd7-a25d-aba269b98b8c None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:01:22.512483 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:01:22.517810 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b821a533-1bb0-4e5e-b602-6ad459ab3eb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:01:22.518434 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b821a533-1bb0-4e5e-b602-6ad459ab3eb7 None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:01:22.518712 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b821a533-1bb0-4e5e-b602-6ad459ab3eb7 None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:01:22.518984 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b821a533-1bb0-4e5e-b602-6ad459ab3eb7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:01:22.529447 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b821a533-1bb0-4e5e-b602-6ad459ab3eb7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:01:22.530935 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b821a533-1bb0-4e5e-b602-6ad459ab3eb7 None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:01:22.544477 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application [None req-b821a533-1bb0-4e5e-b602-6ad459ab3eb7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 19:01:22.544477 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 19:01:22.544477 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 19:01:22.544477 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 19:01:22.544477 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 19:01:22.544477 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 19:01:22.544477 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 19:01:22.544477 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 19:01:22.544477 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 19:01:22.544477 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 19:01:22.544477 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 19:01:22.544477 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 19:01:22.544477 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 28 19:01:22.544477 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 28 19:01:22.544477 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 28 19:01:22.544477 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 28 19:01:22.545638 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 19:01:22.545638 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 19:01:22.545638 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 19:01:22.545638 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 19:01:22.545638 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 19:01:22.545638 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 19:01:22.545638 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 19:01:22.545638 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application with Lock( Oct 28 19:01:22.545638 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 19:01:22.545638 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._enter() Oct 28 19:01:22.545638 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 19:01:22.545638 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 19:01:22.545638 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 19:01:22.545638 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.creator() Oct 28 19:01:22.545638 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 19:01:22.545638 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application created_value = creator( Oct 28 19:01:22.545638 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 28 19:01:22.546504 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 28 19:01:22.546504 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 19:01:22.546504 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application Oct 28 19:01:22.549630 dv-cinder-862365-1-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 200/402] 10.222.0.23 () {56 vars in 1108 bytes} [Fri Oct 28 19:01:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 19:01:22.550482 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b821a533-1bb0-4e5e-b602-6ad459ab3eb7 None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:01:22.555984 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:01:22.608414 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2071ffea-b178-4fd7-a25d-aba269b98b8c None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:01:22.641095 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af9042e-fb6f-48bf-993d-de51443eff79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:01:22.641719 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af9042e-fb6f-48bf-993d-de51443eff79 None admin] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:01:22.641999 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af9042e-fb6f-48bf-993d-de51443eff79 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:01:22.642272 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af9042e-fb6f-48bf-993d-de51443eff79 None admin] PATH_INFO: `/v3/users` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:01:22.642907 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af9042e-fb6f-48bf-993d-de51443eff79 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:01:22.644328 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af9042e-fb6f-48bf-993d-de51443eff79 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:01:22.649996 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b821a533-1bb0-4e5e-b602-6ad459ab3eb7 None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:01:22.683282 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bea6f39-7bf7-4af7-84c4-e6b04986ba1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:01:22.683926 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bea6f39-7bf7-4af7-84c4-e6b04986ba1a None admin] REQUEST_METHOD: `PUT` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:01:22.684211 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bea6f39-7bf7-4af7-84c4-e6b04986ba1a None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:01:22.684485 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bea6f39-7bf7-4af7-84c4-e6b04986ba1a None admin] PATH_INFO: `/v3/projects/b705897907f042c0818a931052438e1e/users/8877180cd9844dad8b0980de34769ec8/roles/068b73485c0e46cb8a8d88b948028746` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:01:22.698430 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bea6f39-7bf7-4af7-84c4-e6b04986ba1a None admin] RBAC: Authorizing `identity:create_grant(project_id=b705897907f042c0818a931052438e1e, user_id=8877180cd9844dad8b0980de34769ec8, role_id=068b73485c0e46cb8a8d88b948028746)` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:01:22.699816 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bea6f39-7bf7-4af7-84c4-e6b04986ba1a None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:01:22.744565 dv-cinder-862365-1-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 203/403] 10.222.0.23 () {60 vars in 1132 bytes} [Fri Oct 28 19:01:22 2022] POST /identity/v3/users => generated 247 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 19:01:22.746234 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af9042e-fb6f-48bf-993d-de51443eff79 None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:01:22.775078 dv-cinder-862365-1-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 201/404] 10.222.0.23 () {58 vars in 1439 bytes} [Fri Oct 28 19:01:22 2022] PUT /identity/v3/projects/b705897907f042c0818a931052438e1e/users/8877180cd9844dad8b0980de34769ec8/roles/068b73485c0e46cb8a8d88b948028746 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 19:01:22.776231 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bea6f39-7bf7-4af7-84c4-e6b04986ba1a None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:01:22.825460 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:01:22.916891 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af9042e-fb6f-48bf-993d-de51443eff79 None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:01:22.920807 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:01:22.922670 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bea6f39-7bf7-4af7-84c4-e6b04986ba1a None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:01:22.968648 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27eb536b-e0c6-4eb3-a947-34ca4dfa75f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:01:22.970680 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27eb536b-e0c6-4eb3-a947-34ca4dfa75f9 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:01:22.970680 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27eb536b-e0c6-4eb3-a947-34ca4dfa75f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:01:22.970680 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27eb536b-e0c6-4eb3-a947-34ca4dfa75f9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:01:22.979191 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27eb536b-e0c6-4eb3-a947-34ca4dfa75f9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:01:22.979950 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb905ade-8e4b-4de6-8b8d-79bfc0d97745 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:01:22.980609 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb905ade-8e4b-4de6-8b8d-79bfc0d97745 None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:01:22.980711 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27eb536b-e0c6-4eb3-a947-34ca4dfa75f9 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:01:22.980887 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb905ade-8e4b-4de6-8b8d-79bfc0d97745 None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:01:22.981160 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb905ade-8e4b-4de6-8b8d-79bfc0d97745 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:01:22.990160 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb905ade-8e4b-4de6-8b8d-79bfc0d97745 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:01:22.991622 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb905ade-8e4b-4de6-8b8d-79bfc0d97745 None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:01:22.995199 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application [None req-27eb536b-e0c6-4eb3-a947-34ca4dfa75f9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 28 19:01:22.995199 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 19:01:22.995199 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 19:01:22.995199 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 19:01:22.995199 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 19:01:22.995199 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 19:01:22.995199 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 19:01:22.995199 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 19:01:22.995199 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 19:01:22.995199 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 19:01:22.995199 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 19:01:22.995199 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 19:01:22.995199 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 28 19:01:22.995199 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 28 19:01:22.995199 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 28 19:01:22.996046 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 28 19:01:22.996046 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 19:01:22.996046 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 19:01:22.996046 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 19:01:22.996046 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 19:01:22.996046 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 19:01:22.996046 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 19:01:22.996046 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 19:01:22.996046 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application with Lock( Oct 28 19:01:22.996046 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 19:01:22.996046 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._enter() Oct 28 19:01:22.996046 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 19:01:22.996046 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 19:01:22.996046 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 19:01:22.996046 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.creator() Oct 28 19:01:22.996046 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 19:01:22.996046 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application created_value = creator( Oct 28 19:01:22.996901 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 28 19:01:22.996901 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 28 19:01:22.996901 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 28 19:01:22.996901 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 28 19:01:22.996901 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 28 19:01:22.996901 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 28 19:01:22.996901 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 28 19:01:22.996901 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Oct 28 19:01:22.996901 dv-cinder-862365-1-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 204/405] 10.222.0.23 () {56 vars in 1111 bytes} [Fri Oct 28 19:01:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 19:01:22.997996 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27eb536b-e0c6-4eb3-a947-34ca4dfa75f9 None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:01:23.004552 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application [None req-bb905ade-8e4b-4de6-8b8d-79bfc0d97745 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Oct 28 19:01:23.004552 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 19:01:23.004552 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 19:01:23.004552 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 19:01:23.004552 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 19:01:23.004552 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 19:01:23.004552 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 19:01:23.004552 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 19:01:23.004552 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 19:01:23.004552 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 19:01:23.004552 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 19:01:23.004552 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 19:01:23.004552 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 28 19:01:23.004552 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 28 19:01:23.004552 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 28 19:01:23.004552 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 28 19:01:23.005482 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 19:01:23.005482 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 19:01:23.005482 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 28 19:01:23.005482 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 28 19:01:23.005482 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 28 19:01:23.005482 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 28 19:01:23.005482 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 19:01:23.005482 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 19:01:23.005482 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 19:01:23.005482 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 19:01:23.005482 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 19:01:23.005482 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application with Lock( Oct 28 19:01:23.005482 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 19:01:23.005482 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._enter() Oct 28 19:01:23.005482 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 19:01:23.005482 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 19:01:23.005482 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 19:01:23.005482 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.creator() Oct 28 19:01:23.006379 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 19:01:23.006379 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application created_value = creator( Oct 28 19:01:23.006379 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 28 19:01:23.006379 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 28 19:01:23.006379 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 28 19:01:23.006379 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 28 19:01:23.006379 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 28 19:01:23.006379 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 28 19:01:23.006379 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Oct 28 19:01:23.006379 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application Oct 28 19:01:23.006379 dv-cinder-862365-1-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 202/406] 10.222.0.23 () {56 vars in 1102 bytes} [Fri Oct 28 19:01:22 2022] GET /identity/v3/users/neutron => generated 85 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 19:01:23.006935 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb905ade-8e4b-4de6-8b8d-79bfc0d97745 None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:01:23.118461 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27eb536b-e0c6-4eb3-a947-34ca4dfa75f9 None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:01:23.129147 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:01:23.141990 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb905ade-8e4b-4de6-8b8d-79bfc0d97745 None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:01:23.166456 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89463869-fe93-47a4-a90d-05538353105a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:01:23.167134 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89463869-fe93-47a4-a90d-05538353105a None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:01:23.167414 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89463869-fe93-47a4-a90d-05538353105a None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:01:23.167687 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89463869-fe93-47a4-a90d-05538353105a None admin] PATH_INFO: `/v3/domains` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:01:23.168611 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89463869-fe93-47a4-a90d-05538353105a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:01:23.168913 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89463869-fe93-47a4-a90d-05538353105a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:01:23.170477 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89463869-fe93-47a4-a90d-05538353105a None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:01:23.184249 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f7e6de-0746-43fa-9a38-a74c9abab201 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:01:23.185759 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f7e6de-0746-43fa-9a38-a74c9abab201 None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:01:23.186323 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f7e6de-0746-43fa-9a38-a74c9abab201 None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:01:23.186830 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f7e6de-0746-43fa-9a38-a74c9abab201 None admin] PATH_INFO: `/v3/projects` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:01:23.187695 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f7e6de-0746-43fa-9a38-a74c9abab201 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81765) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:01:23.188178 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f7e6de-0746-43fa-9a38-a74c9abab201 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:01:23.188355 dv-cinder-862365-1-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 205/407] 10.222.0.23 () {56 vars in 1109 bytes} [Fri Oct 28 19:01:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:01:23.189292 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89463869-fe93-47a4-a90d-05538353105a None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:01:23.190574 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f7e6de-0746-43fa-9a38-a74c9abab201 None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:01:23.215141 dv-cinder-862365-1-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 203/408] 10.222.0.23 () {56 vars in 1148 bytes} [Fri Oct 28 19:01:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:01:23.216444 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f7e6de-0746-43fa-9a38-a74c9abab201 None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:01:23.217901 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:01:23.312042 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89463869-fe93-47a4-a90d-05538353105a None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:01:23.338703 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f7e6de-0746-43fa-9a38-a74c9abab201 None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:01:23.350582 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b2584a-7c31-46c9-a627-2d7500d2df26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:01:23.351474 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b2584a-7c31-46c9-a627-2d7500d2df26 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:01:23.351928 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b2584a-7c31-46c9-a627-2d7500d2df26 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:01:23.352401 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b2584a-7c31-46c9-a627-2d7500d2df26 None admin] PATH_INFO: `/v3/users` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:01:23.353399 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b2584a-7c31-46c9-a627-2d7500d2df26 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:01:23.354420 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b2584a-7c31-46c9-a627-2d7500d2df26 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:01:23.356064 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b2584a-7c31-46c9-a627-2d7500d2df26 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:01:23.375102 dv-cinder-862365-1-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 206/409] 10.222.0.23 () {56 vars in 1139 bytes} [Fri Oct 28 19:01:23 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:01:23.376300 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b2584a-7c31-46c9-a627-2d7500d2df26 None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:01:23.377596 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd517248-e817-4a14-b37f-840d7368d7c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:01:23.378288 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd517248-e817-4a14-b37f-840d7368d7c6 None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:01:23.378572 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd517248-e817-4a14-b37f-840d7368d7c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:01:23.378840 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd517248-e817-4a14-b37f-840d7368d7c6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:01:23.386610 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd517248-e817-4a14-b37f-840d7368d7c6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:01:23.388113 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd517248-e817-4a14-b37f-840d7368d7c6 None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:01:23.400345 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application [None req-dd517248-e817-4a14-b37f-840d7368d7c6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 28 19:01:23.400345 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 19:01:23.400345 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 19:01:23.400345 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 19:01:23.400345 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 19:01:23.400345 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 19:01:23.400345 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 19:01:23.400345 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 19:01:23.400345 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 19:01:23.400345 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 19:01:23.400345 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 19:01:23.400345 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 19:01:23.400345 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 28 19:01:23.400345 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 28 19:01:23.400345 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 28 19:01:23.401322 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 28 19:01:23.401322 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 19:01:23.401322 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 19:01:23.401322 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 19:01:23.401322 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 19:01:23.401322 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 19:01:23.401322 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 19:01:23.401322 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 19:01:23.401322 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application with Lock( Oct 28 19:01:23.401322 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 19:01:23.401322 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._enter() Oct 28 19:01:23.401322 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 19:01:23.401322 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 19:01:23.401322 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 19:01:23.401322 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.creator() Oct 28 19:01:23.401322 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 19:01:23.401322 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application created_value = creator( Oct 28 19:01:23.402190 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 28 19:01:23.402190 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 28 19:01:23.402190 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 28 19:01:23.402190 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 28 19:01:23.402190 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 28 19:01:23.402190 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 28 19:01:23.402190 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 28 19:01:23.402190 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application Oct 28 19:01:23.402190 dv-cinder-862365-1-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 204/410] 10.222.0.23 () {56 vars in 1111 bytes} [Fri Oct 28 19:01:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 19:01:23.402645 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd517248-e817-4a14-b37f-840d7368d7c6 None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:01:23.464818 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:01:23.469762 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:01:23.484354 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b2584a-7c31-46c9-a627-2d7500d2df26 None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:01:23.509500 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd517248-e817-4a14-b37f-840d7368d7c6 None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:01:23.520857 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4c68d9-23f6-47d3-800c-61223c4afdfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:01:23.521764 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4c68d9-23f6-47d3-800c-61223c4afdfb None admin] REQUEST_METHOD: `PUT` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:01:23.522087 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4c68d9-23f6-47d3-800c-61223c4afdfb None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:01:23.522544 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4c68d9-23f6-47d3-800c-61223c4afdfb None admin] PATH_INFO: `/v3/projects/b705897907f042c0818a931052438e1e/users/c855af0d7b0746d2b8fdf3f0b8e58cd3/roles/068b73485c0e46cb8a8d88b948028746` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:01:23.538956 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e4c68d9-23f6-47d3-800c-61223c4afdfb None admin] RBAC: Authorizing `identity:create_grant(project_id=b705897907f042c0818a931052438e1e, user_id=c855af0d7b0746d2b8fdf3f0b8e58cd3, role_id=068b73485c0e46cb8a8d88b948028746)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:01:23.540536 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e4c68d9-23f6-47d3-800c-61223c4afdfb None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:01:23.549206 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a7b3aa-e362-405e-aae2-b9f7f07e979c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:01:23.550071 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a7b3aa-e362-405e-aae2-b9f7f07e979c None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:01:23.550520 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a7b3aa-e362-405e-aae2-b9f7f07e979c None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:01:23.550985 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a7b3aa-e362-405e-aae2-b9f7f07e979c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:01:23.563164 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a7b3aa-e362-405e-aae2-b9f7f07e979c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:01:23.564787 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a7b3aa-e362-405e-aae2-b9f7f07e979c None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:01:23.579398 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application [None req-b7a7b3aa-e362-405e-aae2-b9f7f07e979c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 19:01:23.579398 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 19:01:23.579398 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 19:01:23.579398 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 19:01:23.579398 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 19:01:23.579398 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 19:01:23.579398 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 19:01:23.579398 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 19:01:23.579398 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 19:01:23.579398 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 19:01:23.579398 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 19:01:23.579398 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 19:01:23.579398 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 28 19:01:23.579398 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 28 19:01:23.579398 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 28 19:01:23.579398 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 28 19:01:23.580407 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 19:01:23.580407 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 19:01:23.580407 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 19:01:23.580407 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 19:01:23.580407 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 19:01:23.580407 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 19:01:23.580407 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 19:01:23.580407 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application with Lock( Oct 28 19:01:23.580407 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 19:01:23.580407 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._enter() Oct 28 19:01:23.580407 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 19:01:23.580407 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 19:01:23.580407 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 19:01:23.580407 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.creator() Oct 28 19:01:23.580407 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 19:01:23.580407 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application created_value = creator( Oct 28 19:01:23.580407 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 28 19:01:23.581272 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 28 19:01:23.581272 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 19:01:23.581272 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application Oct 28 19:01:23.581272 dv-cinder-862365-1-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 205/411] 10.222.0.23 () {56 vars in 1108 bytes} [Fri Oct 28 19:01:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 19:01:23.582145 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a7b3aa-e362-405e-aae2-b9f7f07e979c None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:01:23.638723 dv-cinder-862365-1-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 207/412] 10.222.0.23 () {58 vars in 1439 bytes} [Fri Oct 28 19:01:23 2022] PUT /identity/v3/projects/b705897907f042c0818a931052438e1e/users/c855af0d7b0746d2b8fdf3f0b8e58cd3/roles/068b73485c0e46cb8a8d88b948028746 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 19:01:23.640642 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4c68d9-23f6-47d3-800c-61223c4afdfb None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:01:23.660471 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:01:23.789464 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a7b3aa-e362-405e-aae2-b9f7f07e979c None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:01:23.814316 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4c68d9-23f6-47d3-800c-61223c4afdfb None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:01:23.848271 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbdf4b7-00d0-4cb3-a5f1-5ebe5a4323dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:01:23.848885 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbdf4b7-00d0-4cb3-a5f1-5ebe5a4323dd None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:01:23.849162 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbdf4b7-00d0-4cb3-a5f1-5ebe5a4323dd None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:01:23.849458 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbdf4b7-00d0-4cb3-a5f1-5ebe5a4323dd None admin] PATH_INFO: `/v3/projects` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:01:23.850156 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcbdf4b7-00d0-4cb3-a5f1-5ebe5a4323dd None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81765) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:01:23.850460 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcbdf4b7-00d0-4cb3-a5f1-5ebe5a4323dd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:01:23.851895 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcbdf4b7-00d0-4cb3-a5f1-5ebe5a4323dd None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:01:23.865392 dv-cinder-862365-1-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 206/413] 10.222.0.23 () {56 vars in 1148 bytes} [Fri Oct 28 19:01:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:01:23.869787 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:01:23.874374 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbdf4b7-00d0-4cb3-a5f1-5ebe5a4323dd None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:01:23.875176 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30e2017-d4a0-4789-90c5-a0bbc9bd8a14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:01:23.875895 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30e2017-d4a0-4789-90c5-a0bbc9bd8a14 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:01:23.876185 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30e2017-d4a0-4789-90c5-a0bbc9bd8a14 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:01:23.876459 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30e2017-d4a0-4789-90c5-a0bbc9bd8a14 None admin] PATH_INFO: `/v3/domains` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:01:23.877108 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a30e2017-d4a0-4789-90c5-a0bbc9bd8a14 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:01:23.877445 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a30e2017-d4a0-4789-90c5-a0bbc9bd8a14 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:01:23.879143 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a30e2017-d4a0-4789-90c5-a0bbc9bd8a14 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:01:23.896112 dv-cinder-862365-1-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 208/414] 10.222.0.23 () {56 vars in 1109 bytes} [Fri Oct 28 19:01:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:01:23.901859 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30e2017-d4a0-4789-90c5-a0bbc9bd8a14 None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:01:24.042827 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbdf4b7-00d0-4cb3-a5f1-5ebe5a4323dd None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:01:24.046783 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30e2017-d4a0-4789-90c5-a0bbc9bd8a14 None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:01:24.076728 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:01:24.089340 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43781e47-d57e-45b2-8123-175f6da08894 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:01:24.090280 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43781e47-d57e-45b2-8123-175f6da08894 None admin] REQUEST_METHOD: `PUT` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:01:24.090705 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43781e47-d57e-45b2-8123-175f6da08894 None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:01:24.091258 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43781e47-d57e-45b2-8123-175f6da08894 None admin] PATH_INFO: `/v3/projects/b705897907f042c0818a931052438e1e/users/e441de25d614487c80452642c67df04a/roles/068b73485c0e46cb8a8d88b948028746` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:01:24.113153 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43781e47-d57e-45b2-8123-175f6da08894 None admin] RBAC: Authorizing `identity:create_grant(project_id=b705897907f042c0818a931052438e1e, user_id=e441de25d614487c80452642c67df04a, role_id=068b73485c0e46cb8a8d88b948028746)` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:01:24.114889 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43781e47-d57e-45b2-8123-175f6da08894 None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:01:24.124766 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9b3fff-7fce-412a-b5ab-5ea780c54240 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:01:24.125747 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9b3fff-7fce-412a-b5ab-5ea780c54240 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:01:24.126476 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9b3fff-7fce-412a-b5ab-5ea780c54240 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:01:24.130391 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9b3fff-7fce-412a-b5ab-5ea780c54240 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:01:24.134981 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c9b3fff-7fce-412a-b5ab-5ea780c54240 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:01:24.137261 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c9b3fff-7fce-412a-b5ab-5ea780c54240 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:01:24.149696 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application [None req-6c9b3fff-7fce-412a-b5ab-5ea780c54240 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 28 19:01:24.149696 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 19:01:24.149696 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 19:01:24.149696 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 19:01:24.149696 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 19:01:24.149696 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 19:01:24.149696 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 19:01:24.149696 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 19:01:24.149696 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 19:01:24.149696 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 19:01:24.149696 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 19:01:24.149696 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 19:01:24.149696 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 28 19:01:24.149696 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 28 19:01:24.149696 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 28 19:01:24.152494 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 28 19:01:24.152494 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 19:01:24.152494 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 19:01:24.152494 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 19:01:24.152494 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 19:01:24.152494 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 19:01:24.152494 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 19:01:24.152494 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 19:01:24.152494 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application with Lock( Oct 28 19:01:24.152494 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 19:01:24.152494 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._enter() Oct 28 19:01:24.152494 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 19:01:24.152494 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 19:01:24.152494 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 19:01:24.152494 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.creator() Oct 28 19:01:24.152494 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 19:01:24.152494 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application created_value = creator( Oct 28 19:01:24.153612 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 28 19:01:24.153612 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 28 19:01:24.153612 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 28 19:01:24.153612 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 28 19:01:24.153612 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 28 19:01:24.153612 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 28 19:01:24.153612 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 28 19:01:24.153612 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Oct 28 19:01:24.155709 dv-cinder-862365-1-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 209/415] 10.222.0.23 () {56 vars in 1111 bytes} [Fri Oct 28 19:01:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 19:01:24.161846 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9b3fff-7fce-412a-b5ab-5ea780c54240 None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:01:24.221896 dv-cinder-862365-1-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 207/416] 10.222.0.23 () {58 vars in 1439 bytes} [Fri Oct 28 19:01:23 2022] PUT /identity/v3/projects/b705897907f042c0818a931052438e1e/users/e441de25d614487c80452642c67df04a/roles/068b73485c0e46cb8a8d88b948028746 => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 19:01:24.239036 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:01:24.296291 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9b3fff-7fce-412a-b5ab-5ea780c54240 None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:01:24.336925 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4074dd-ade3-4bdb-80fe-205ef7112b1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:01:24.337802 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4074dd-ade3-4bdb-80fe-205ef7112b1a None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:01:24.338227 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4074dd-ade3-4bdb-80fe-205ef7112b1a None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:01:24.339229 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4074dd-ade3-4bdb-80fe-205ef7112b1a None admin] PATH_INFO: `/v3/projects` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:01:24.340180 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a4074dd-ade3-4bdb-80fe-205ef7112b1a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:01:24.340638 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a4074dd-ade3-4bdb-80fe-205ef7112b1a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:01:24.342342 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a4074dd-ade3-4bdb-80fe-205ef7112b1a None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:01:24.356737 dv-cinder-862365-1-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 210/417] 10.222.0.23 () {56 vars in 1148 bytes} [Fri Oct 28 19:01:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:01:24.362351 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43781e47-d57e-45b2-8123-175f6da08894 None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:01:24.485263 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43781e47-d57e-45b2-8123-175f6da08894 None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:01:24.524870 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f067547b-6dd8-4e41-b1e7-ffffa1947079 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:01:24.525879 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f067547b-6dd8-4e41-b1e7-ffffa1947079 None admin] REQUEST_METHOD: `PUT` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:01:24.526307 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f067547b-6dd8-4e41-b1e7-ffffa1947079 None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:01:24.526752 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f067547b-6dd8-4e41-b1e7-ffffa1947079 None admin] PATH_INFO: `/v3/projects/b705897907f042c0818a931052438e1e/users/a31a9efd8dc04c9aa64c42a3779c550d/roles/068b73485c0e46cb8a8d88b948028746` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:01:24.544004 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f067547b-6dd8-4e41-b1e7-ffffa1947079 None admin] RBAC: Authorizing `identity:create_grant(project_id=b705897907f042c0818a931052438e1e, user_id=a31a9efd8dc04c9aa64c42a3779c550d, role_id=068b73485c0e46cb8a8d88b948028746)` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:01:24.545726 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f067547b-6dd8-4e41-b1e7-ffffa1947079 None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:01:24.636453 dv-cinder-862365-1-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 208/418] 10.222.0.23 () {58 vars in 1439 bytes} [Fri Oct 28 19:01:24 2022] PUT /identity/v3/projects/b705897907f042c0818a931052438e1e/users/a31a9efd8dc04c9aa64c42a3779c550d/roles/068b73485c0e46cb8a8d88b948028746 => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 19:01:25.239496 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb050ab-a5f6-4582-aae4-52faa375788a None None] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:01:25.240039 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb050ab-a5f6-4582-aae4-52faa375788a None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:01:25.240325 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb050ab-a5f6-4582-aae4-52faa375788a None None] PATH_INFO: `/` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:01:25.242084 dv-cinder-862365-1-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 211/419] 10.222.0.23 () {54 vars in 927 bytes} [Fri Oct 28 19:01:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 19:01:25.250571 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab176d26-5620-4a89-8d21-ff7caed110f6 None None] REQUEST_METHOD: `POST` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:01:25.251045 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab176d26-5620-4a89-8d21-ff7caed110f6 None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:01:25.251123 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab176d26-5620-4a89-8d21-ff7caed110f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:01:25.263883 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c98988b-0aae-46b3-be56-5fb6e06f4b3c None None] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:01:25.264163 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c98988b-0aae-46b3-be56-5fb6e06f4b3c None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:01:25.265257 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c98988b-0aae-46b3-be56-5fb6e06f4b3c None None] PATH_INFO: `/` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:01:25.266038 dv-cinder-862365-1-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 212/420] 10.222.0.23 () {54 vars in 927 bytes} [Fri Oct 28 19:01:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 19:01:25.271420 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a883ced-213d-419f-8918-764e83ce0b0d None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:01:25.271699 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a883ced-213d-419f-8918-764e83ce0b0d None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:01:25.271980 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a883ced-213d-419f-8918-764e83ce0b0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:01:25.282567 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.auth.core [None req-ab176d26-5620-4a89-8d21-ff7caed110f6 None None] MFA Rules not processed for user `ae863915635746d1ac19970949de4722`. Rule list: `[]` (Enabled: `True`). {{(pid=81765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:01:25.283826 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-ab176d26-5620-4a89-8d21-ff7caed110f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:01:25.296822 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-5a883ced-213d-419f-8918-764e83ce0b0d None None] MFA Rules not processed for user `ae863915635746d1ac19970949de4722`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:01:25.298067 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-5a883ced-213d-419f-8918-764e83ce0b0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:01:25.317716 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:01:25.406086 dv-cinder-862365-1-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 209/421] 10.222.0.23 () {58 vars in 1024 bytes} [Fri Oct 28 19:01:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 28 19:01:25.420666 dv-cinder-862365-1-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 213/422] 10.222.0.23 () {58 vars in 1024 bytes} [Fri Oct 28 19:01:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 28 19:01:25.693850 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab176d26-5620-4a89-8d21-ff7caed110f6 None None] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:01:25.816319 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab176d26-5620-4a89-8d21-ff7caed110f6 None None] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:01:25.838522 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a883ced-213d-419f-8918-764e83ce0b0d None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:01:25.865302 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6b6aef-d0f2-4eae-88fe-8b40f3f4d52c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:01:25.865966 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6b6aef-d0f2-4eae-88fe-8b40f3f4d52c None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:01:25.866250 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6b6aef-d0f2-4eae-88fe-8b40f3f4d52c None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:01:25.866525 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6b6aef-d0f2-4eae-88fe-8b40f3f4d52c None admin] PATH_INFO: `/v3/roles/service` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:01:25.877469 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee6b6aef-d0f2-4eae-88fe-8b40f3f4d52c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 19:01:25.882437 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application [None req-ee6b6aef-d0f2-4eae-88fe-8b40f3f4d52c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 28 19:01:25.882437 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 19:01:25.882437 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 19:01:25.882437 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 19:01:25.882437 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 19:01:25.882437 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 19:01:25.882437 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 19:01:25.882437 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 19:01:25.882437 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 19:01:25.882437 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 19:01:25.882437 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 19:01:25.882437 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 19:01:25.882437 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 28 19:01:25.882437 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 28 19:01:25.882437 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 28 19:01:25.882437 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 28 19:01:25.883327 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 28 19:01:25.883327 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 28 19:01:25.883327 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 28 19:01:25.883327 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 28 19:01:25.883327 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 19:01:25.883327 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 19:01:25.883327 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 19:01:25.883327 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 19:01:25.883327 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 19:01:25.883327 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 19:01:25.883327 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 19:01:25.883327 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application with Lock( Oct 28 19:01:25.883327 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 19:01:25.883327 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._enter() Oct 28 19:01:25.883327 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 19:01:25.883327 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 19:01:25.884123 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 19:01:25.884123 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.creator() Oct 28 19:01:25.884123 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 19:01:25.884123 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application created_value = creator( Oct 28 19:01:25.884123 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 28 19:01:25.884123 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 28 19:01:25.884123 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 28 19:01:25.884123 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 28 19:01:25.884123 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 28 19:01:25.884123 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 28 19:01:25.884123 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 28 19:01:25.884123 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application Oct 28 19:01:25.884123 dv-cinder-862365-1-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 210/423] 10.222.0.23 () {56 vars in 1102 bytes} [Fri Oct 28 19:01:25 2022] GET /identity/v3/roles/service => generated 85 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 19:01:25.889776 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6b6aef-d0f2-4eae-88fe-8b40f3f4d52c None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:01:25.906360 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:01:25.969295 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:01:26.046882 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6b6aef-d0f2-4eae-88fe-8b40f3f4d52c None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:01:26.080265 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a883ced-213d-419f-8918-764e83ce0b0d None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:01:26.119315 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45378e4c-577b-471d-8e4a-dede16fd435d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:01:26.120303 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45378e4c-577b-471d-8e4a-dede16fd435d None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:01:26.120781 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45378e4c-577b-471d-8e4a-dede16fd435d None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:01:26.121265 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45378e4c-577b-471d-8e4a-dede16fd435d None admin] PATH_INFO: `/v3/roles` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:01:26.122191 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45378e4c-577b-471d-8e4a-dede16fd435d None admin] RBAC: Adding query filter params (name=service) {{(pid=81765) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:01:26.122689 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45378e4c-577b-471d-8e4a-dede16fd435d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:01:26.124259 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45378e4c-577b-471d-8e4a-dede16fd435d None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:01:26.133385 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a9f016-be69-49eb-9746-75b42c9dd274 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:01:26.133385 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a9f016-be69-49eb-9746-75b42c9dd274 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:01:26.133385 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a9f016-be69-49eb-9746-75b42c9dd274 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:01:26.133385 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a9f016-be69-49eb-9746-75b42c9dd274 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:01:26.139794 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a9f016-be69-49eb-9746-75b42c9dd274 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 19:01:26.141840 dv-cinder-862365-1-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 211/424] 10.222.0.23 () {56 vars in 1103 bytes} [Fri Oct 28 19:01:25 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:01:26.144633 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application [None req-f8a9f016-be69-49eb-9746-75b42c9dd274 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 28 19:01:26.144633 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 19:01:26.144633 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 19:01:26.144633 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 19:01:26.144633 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 19:01:26.144633 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 19:01:26.144633 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 19:01:26.144633 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 19:01:26.144633 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 19:01:26.144633 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 19:01:26.144633 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 19:01:26.144633 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 19:01:26.144633 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 28 19:01:26.144633 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 28 19:01:26.144633 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 28 19:01:26.144633 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 28 19:01:26.145543 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 28 19:01:26.145543 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 28 19:01:26.145543 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 28 19:01:26.145543 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 28 19:01:26.145543 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 19:01:26.145543 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 19:01:26.145543 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 19:01:26.145543 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 19:01:26.145543 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 19:01:26.145543 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 19:01:26.145543 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 19:01:26.145543 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application with Lock( Oct 28 19:01:26.145543 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 19:01:26.145543 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._enter() Oct 28 19:01:26.145543 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 19:01:26.145543 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 19:01:26.146353 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 19:01:26.146353 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.creator() Oct 28 19:01:26.146353 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 19:01:26.146353 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application created_value = creator( Oct 28 19:01:26.146353 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 28 19:01:26.146353 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 28 19:01:26.146353 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 28 19:01:26.146353 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 28 19:01:26.146353 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 28 19:01:26.146353 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 28 19:01:26.146353 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 28 19:01:26.146353 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Oct 28 19:01:26.153381 dv-cinder-862365-1-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 214/425] 10.222.0.23 () {56 vars in 1102 bytes} [Fri Oct 28 19:01:25 2022] GET /identity/v3/roles/service => generated 85 bytes in 313 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 28 19:01:26.154593 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45378e4c-577b-471d-8e4a-dede16fd435d None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:01:26.159330 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a9f016-be69-49eb-9746-75b42c9dd274 None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:01:26.295920 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a9f016-be69-49eb-9746-75b42c9dd274 None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:01:26.297716 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:01:26.311683 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:01:26.356301 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1414644-91b0-40ba-bfd4-1ba8b5901cda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:01:26.357188 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1414644-91b0-40ba-bfd4-1ba8b5901cda None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:01:26.357637 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1414644-91b0-40ba-bfd4-1ba8b5901cda None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:01:26.358053 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1414644-91b0-40ba-bfd4-1ba8b5901cda None admin] PATH_INFO: `/v3/roles` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:01:26.358879 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1414644-91b0-40ba-bfd4-1ba8b5901cda None admin] RBAC: Adding query filter params (name=service) {{(pid=81766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:01:26.360817 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45378e4c-577b-471d-8e4a-dede16fd435d None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:01:26.361279 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1414644-91b0-40ba-bfd4-1ba8b5901cda None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:01:26.362890 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1414644-91b0-40ba-bfd4-1ba8b5901cda None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:01:26.372896 dv-cinder-862365-1-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 215/426] 10.222.0.23 () {56 vars in 1103 bytes} [Fri Oct 28 19:01:26 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:01:26.381912 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1414644-91b0-40ba-bfd4-1ba8b5901cda None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:01:26.445384 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a01d8c-f6f7-41dc-86cb-c5f9b0ebcfee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:01:26.446410 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a01d8c-f6f7-41dc-86cb-c5f9b0ebcfee None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:01:26.446894 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a01d8c-f6f7-41dc-86cb-c5f9b0ebcfee None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:01:26.447393 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a01d8c-f6f7-41dc-86cb-c5f9b0ebcfee None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:01:26.465566 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a01d8c-f6f7-41dc-86cb-c5f9b0ebcfee None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:01:26.467349 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a01d8c-f6f7-41dc-86cb-c5f9b0ebcfee None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:01:26.485747 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application [None req-28a01d8c-f6f7-41dc-86cb-c5f9b0ebcfee None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 19:01:26.485747 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 19:01:26.485747 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 19:01:26.485747 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 19:01:26.485747 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 19:01:26.485747 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 19:01:26.485747 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 19:01:26.485747 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 19:01:26.485747 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 19:01:26.485747 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 19:01:26.485747 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 19:01:26.485747 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 19:01:26.485747 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 28 19:01:26.485747 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 28 19:01:26.485747 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 28 19:01:26.485747 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 28 19:01:26.486693 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 19:01:26.486693 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 19:01:26.486693 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 19:01:26.486693 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 19:01:26.486693 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 19:01:26.486693 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 19:01:26.486693 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 19:01:26.486693 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application with Lock( Oct 28 19:01:26.486693 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 19:01:26.486693 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._enter() Oct 28 19:01:26.486693 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 19:01:26.486693 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 19:01:26.486693 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 19:01:26.486693 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.creator() Oct 28 19:01:26.486693 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 19:01:26.486693 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application created_value = creator( Oct 28 19:01:26.486693 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 28 19:01:26.487515 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 28 19:01:26.487515 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 19:01:26.487515 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application Oct 28 19:01:26.490439 dv-cinder-862365-1-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 212/427] 10.222.0.23 () {56 vars in 1108 bytes} [Fri Oct 28 19:01:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 336 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 19:01:26.496367 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a9ef4e-0834-4329-ae80-875004e45daa None None] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:01:26.496655 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a9ef4e-0834-4329-ae80-875004e45daa None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:01:26.496931 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a9ef4e-0834-4329-ae80-875004e45daa None None] PATH_INFO: `/` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:01:26.498518 dv-cinder-862365-1-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 213/428] 10.222.0.23 () {54 vars in 927 bytes} [Fri Oct 28 19:01:26 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 19:01:26.499235 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a9ef4e-0834-4329-ae80-875004e45daa None None] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:01:26.508213 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1414644-91b0-40ba-bfd4-1ba8b5901cda None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:01:26.550901 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09320a1-3b62-49c8-b597-e750635a1fce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:01:26.551448 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09320a1-3b62-49c8-b597-e750635a1fce None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:01:26.551728 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09320a1-3b62-49c8-b597-e750635a1fce None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:01:26.552001 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09320a1-3b62-49c8-b597-e750635a1fce None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:01:26.567330 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09320a1-3b62-49c8-b597-e750635a1fce None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:01:26.568940 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09320a1-3b62-49c8-b597-e750635a1fce None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:01:26.588081 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application [None req-e09320a1-3b62-49c8-b597-e750635a1fce None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 19:01:26.588081 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 19:01:26.588081 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 19:01:26.588081 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 19:01:26.588081 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 19:01:26.588081 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 19:01:26.588081 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 19:01:26.588081 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 19:01:26.588081 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 19:01:26.588081 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 19:01:26.588081 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 19:01:26.588081 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 19:01:26.588081 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 28 19:01:26.588081 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 28 19:01:26.588081 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 28 19:01:26.588081 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 28 19:01:26.589614 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 19:01:26.589614 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 19:01:26.589614 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 19:01:26.589614 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 19:01:26.589614 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 19:01:26.589614 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 19:01:26.589614 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 19:01:26.589614 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application with Lock( Oct 28 19:01:26.589614 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 19:01:26.589614 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._enter() Oct 28 19:01:26.589614 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 19:01:26.589614 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 19:01:26.589614 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 19:01:26.589614 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.creator() Oct 28 19:01:26.589614 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 19:01:26.589614 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application created_value = creator( Oct 28 19:01:26.589614 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 28 19:01:26.590528 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 28 19:01:26.590528 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 19:01:26.590528 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Oct 28 19:01:26.590528 dv-cinder-862365-1-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 216/429] 10.222.0.23 () {56 vars in 1108 bytes} [Fri Oct 28 19:01:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 28 19:01:26.594655 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc3d61d-4da7-4eaf-b9a9-c56390c174fb None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:01:26.596330 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc3d61d-4da7-4eaf-b9a9-c56390c174fb None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:01:26.597631 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc3d61d-4da7-4eaf-b9a9-c56390c174fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:01:26.617504 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-efc3d61d-4da7-4eaf-b9a9-c56390c174fb None None] MFA Rules not processed for user `ae863915635746d1ac19970949de4722`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:01:26.619127 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-efc3d61d-4da7-4eaf-b9a9-c56390c174fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:01:26.631448 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:01:26.632281 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a9ef4e-0834-4329-ae80-875004e45daa None None] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:01:26.659754 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:01:26.667628 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03129eda-ee63-4568-9f10-3795d5ad572d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:01:26.668268 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03129eda-ee63-4568-9f10-3795d5ad572d None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:01:26.668513 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03129eda-ee63-4568-9f10-3795d5ad572d None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:01:26.668795 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03129eda-ee63-4568-9f10-3795d5ad572d None admin] PATH_INFO: `/v3/domains` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:01:26.669707 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03129eda-ee63-4568-9f10-3795d5ad572d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81765) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:01:26.669824 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03129eda-ee63-4568-9f10-3795d5ad572d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:01:26.671243 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03129eda-ee63-4568-9f10-3795d5ad572d None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:01:26.684351 dv-cinder-862365-1-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 214/430] 10.222.0.23 () {56 vars in 1109 bytes} [Fri Oct 28 19:01:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:01:26.689368 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03129eda-ee63-4568-9f10-3795d5ad572d None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:01:26.707048 dv-cinder-862365-1-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 217/431] 10.222.0.23 () {58 vars in 1024 bytes} [Fri Oct 28 19:01:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 28 19:01:26.708308 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc3d61d-4da7-4eaf-b9a9-c56390c174fb None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:01:26.818576 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc3d61d-4da7-4eaf-b9a9-c56390c174fb None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:01:26.846261 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03129eda-ee63-4568-9f10-3795d5ad572d None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:01:26.860238 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc0f70a-c995-4991-8461-ff044a9c35fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:01:26.860884 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc0f70a-c995-4991-8461-ff044a9c35fb None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:01:26.861163 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc0f70a-c995-4991-8461-ff044a9c35fb None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:01:26.861465 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc0f70a-c995-4991-8461-ff044a9c35fb None admin] PATH_INFO: `/v3/users/nova` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:01:26.869273 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc0f70a-c995-4991-8461-ff044a9c35fb None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:01:26.871642 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc0f70a-c995-4991-8461-ff044a9c35fb None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:01:26.884216 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application [None req-ebc0f70a-c995-4991-8461-ff044a9c35fb None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 28 19:01:26.884216 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 19:01:26.884216 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 19:01:26.884216 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 19:01:26.884216 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 19:01:26.884216 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 19:01:26.884216 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 19:01:26.884216 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 19:01:26.884216 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 19:01:26.884216 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 19:01:26.884216 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 19:01:26.884216 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 19:01:26.884216 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 28 19:01:26.884216 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 28 19:01:26.884216 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 28 19:01:26.884216 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 28 19:01:26.885227 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 19:01:26.885227 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 19:01:26.885227 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 28 19:01:26.885227 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 28 19:01:26.885227 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 28 19:01:26.885227 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 28 19:01:26.885227 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 19:01:26.885227 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 19:01:26.885227 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 19:01:26.885227 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 19:01:26.885227 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 19:01:26.885227 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application with Lock( Oct 28 19:01:26.885227 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 19:01:26.885227 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._enter() Oct 28 19:01:26.885227 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 19:01:26.885227 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 19:01:26.885227 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 19:01:26.885227 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.creator() Oct 28 19:01:26.887326 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 19:01:26.887326 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application created_value = creator( Oct 28 19:01:26.887326 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 28 19:01:26.887326 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 28 19:01:26.887326 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 28 19:01:26.887326 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 28 19:01:26.887326 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 28 19:01:26.887326 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 28 19:01:26.887326 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 28 19:01:26.887326 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Oct 28 19:01:26.889561 dv-cinder-862365-1-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 218/432] 10.222.0.23 () {56 vars in 1093 bytes} [Fri Oct 28 19:01:26 2022] GET /identity/v3/users/nova => generated 82 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 19:01:26.890796 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f1db5c-8b47-45bd-a7eb-2866f4d87952 None None] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:01:26.891083 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f1db5c-8b47-45bd-a7eb-2866f4d87952 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:01:26.891395 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f1db5c-8b47-45bd-a7eb-2866f4d87952 None None] PATH_INFO: `/` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:01:26.892617 dv-cinder-862365-1-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 219/433] 10.222.0.23 () {54 vars in 927 bytes} [Fri Oct 28 19:01:26 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 19:01:26.896819 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f1db5c-8b47-45bd-a7eb-2866f4d87952 None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:01:26.900967 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b37e58d-57aa-48c5-ae01-c98d9535bd36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:01:26.901876 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b37e58d-57aa-48c5-ae01-c98d9535bd36 None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:01:26.902363 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b37e58d-57aa-48c5-ae01-c98d9535bd36 None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:01:26.902856 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b37e58d-57aa-48c5-ae01-c98d9535bd36 None admin] PATH_INFO: `/v3/domains` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:01:26.903740 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b37e58d-57aa-48c5-ae01-c98d9535bd36 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81765) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:01:26.904289 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b37e58d-57aa-48c5-ae01-c98d9535bd36 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:01:26.905237 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:01:26.911286 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b37e58d-57aa-48c5-ae01-c98d9535bd36 None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:01:26.926783 dv-cinder-862365-1-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 215/434] 10.222.0.23 () {56 vars in 1109 bytes} [Fri Oct 28 19:01:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:01:26.928188 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed396ea6-f8c5-46ea-ab29-7b704c62de01 None None] REQUEST_METHOD: `POST` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:01:26.928521 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed396ea6-f8c5-46ea-ab29-7b704c62de01 None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:01:26.928762 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed396ea6-f8c5-46ea-ab29-7b704c62de01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:01:26.948355 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.auth.core [None req-ed396ea6-f8c5-46ea-ab29-7b704c62de01 None None] MFA Rules not processed for user `ae863915635746d1ac19970949de4722`. Rule list: `[]` (Enabled: `True`). {{(pid=81765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:01:26.949670 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-ed396ea6-f8c5-46ea-ab29-7b704c62de01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:01:26.996375 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:01:27.014863 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f1db5c-8b47-45bd-a7eb-2866f4d87952 None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:01:27.020344 dv-cinder-862365-1-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 216/435] 10.222.0.23 () {58 vars in 1024 bytes} [Fri Oct 28 19:01:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 28 19:01:27.021175 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed396ea6-f8c5-46ea-ab29-7b704c62de01 None None] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:01:27.064323 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a07f8d-4a9e-483b-9f33-17e0da54f587 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:01:27.065442 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a07f8d-4a9e-483b-9f33-17e0da54f587 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:01:27.066075 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a07f8d-4a9e-483b-9f33-17e0da54f587 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:01:27.066549 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a07f8d-4a9e-483b-9f33-17e0da54f587 None admin] PATH_INFO: `/v3/users` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:01:27.067525 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a07f8d-4a9e-483b-9f33-17e0da54f587 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:01:27.068032 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a07f8d-4a9e-483b-9f33-17e0da54f587 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:01:27.070076 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a07f8d-4a9e-483b-9f33-17e0da54f587 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:01:27.090054 dv-cinder-862365-1-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 220/436] 10.222.0.23 () {56 vars in 1133 bytes} [Fri Oct 28 19:01:26 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 19:01:27.091373 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a07f8d-4a9e-483b-9f33-17e0da54f587 None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:01:27.125679 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed396ea6-f8c5-46ea-ab29-7b704c62de01 None None] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:01:27.159499 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:01:27.162600 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c99af8-6cd7-436c-a437-0dd32ff535ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:01:27.163226 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c99af8-6cd7-436c-a437-0dd32ff535ae None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:01:27.163503 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c99af8-6cd7-436c-a437-0dd32ff535ae None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:01:27.163774 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c99af8-6cd7-436c-a437-0dd32ff535ae None admin] PATH_INFO: `/v3/users/swift` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:01:27.171019 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c99af8-6cd7-436c-a437-0dd32ff535ae None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:01:27.172467 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c99af8-6cd7-436c-a437-0dd32ff535ae None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:01:27.184953 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application [None req-d5c99af8-6cd7-436c-a437-0dd32ff535ae None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Oct 28 19:01:27.184953 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 19:01:27.184953 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 19:01:27.184953 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 19:01:27.184953 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 19:01:27.184953 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 19:01:27.184953 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 19:01:27.184953 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 19:01:27.184953 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 19:01:27.184953 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 19:01:27.184953 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 19:01:27.184953 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 19:01:27.184953 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 28 19:01:27.184953 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 28 19:01:27.184953 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 28 19:01:27.184953 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 28 19:01:27.185947 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 19:01:27.185947 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 19:01:27.185947 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 28 19:01:27.185947 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 28 19:01:27.185947 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 28 19:01:27.185947 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 28 19:01:27.185947 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 19:01:27.185947 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 19:01:27.185947 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 19:01:27.185947 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 19:01:27.185947 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 19:01:27.185947 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application with Lock( Oct 28 19:01:27.185947 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 19:01:27.185947 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._enter() Oct 28 19:01:27.185947 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 19:01:27.185947 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 19:01:27.185947 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 19:01:27.185947 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.creator() Oct 28 19:01:27.187472 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 19:01:27.187472 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application created_value = creator( Oct 28 19:01:27.187472 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 28 19:01:27.187472 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 28 19:01:27.187472 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 28 19:01:27.187472 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 28 19:01:27.187472 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 28 19:01:27.187472 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 28 19:01:27.187472 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Oct 28 19:01:27.187472 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application Oct 28 19:01:27.187472 dv-cinder-862365-1-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 217/437] 10.222.0.23 () {56 vars in 1096 bytes} [Fri Oct 28 19:01:27 2022] GET /identity/v3/users/swift => generated 83 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 19:01:27.187472 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c99af8-6cd7-436c-a437-0dd32ff535ae None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:01:27.207925 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a07f8d-4a9e-483b-9f33-17e0da54f587 None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:01:27.231214 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:01:27.250949 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b8e8a1-a856-42ed-a405-8c03a7efa93c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:01:27.252011 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b8e8a1-a856-42ed-a405-8c03a7efa93c None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:01:27.252591 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b8e8a1-a856-42ed-a405-8c03a7efa93c None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:01:27.253072 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b8e8a1-a856-42ed-a405-8c03a7efa93c None admin] PATH_INFO: `/v3/roles/service` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:01:27.274514 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b8e8a1-a856-42ed-a405-8c03a7efa93c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 19:01:27.284497 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application [None req-06b8e8a1-a856-42ed-a405-8c03a7efa93c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 28 19:01:27.284497 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 19:01:27.284497 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 19:01:27.284497 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 19:01:27.284497 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 19:01:27.284497 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 19:01:27.284497 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 19:01:27.284497 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 19:01:27.284497 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 19:01:27.284497 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 19:01:27.284497 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 19:01:27.284497 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 19:01:27.284497 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 28 19:01:27.284497 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 28 19:01:27.284497 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 28 19:01:27.284497 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 28 19:01:27.285803 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 28 19:01:27.285803 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 28 19:01:27.285803 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 28 19:01:27.285803 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 28 19:01:27.285803 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 19:01:27.285803 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 19:01:27.285803 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 19:01:27.285803 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 19:01:27.285803 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 19:01:27.285803 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 19:01:27.285803 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 19:01:27.285803 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application with Lock( Oct 28 19:01:27.285803 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 19:01:27.285803 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._enter() Oct 28 19:01:27.285803 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 19:01:27.285803 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 19:01:27.286620 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 19:01:27.286620 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.creator() Oct 28 19:01:27.286620 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 19:01:27.286620 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application created_value = creator( Oct 28 19:01:27.286620 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 28 19:01:27.286620 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 28 19:01:27.286620 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 28 19:01:27.286620 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 28 19:01:27.286620 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 28 19:01:27.286620 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 28 19:01:27.286620 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 28 19:01:27.286620 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Oct 28 19:01:27.288958 dv-cinder-862365-1-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 221/438] 10.222.0.23 () {56 vars in 1102 bytes} [Fri Oct 28 19:01:27 2022] GET /identity/v3/roles/service => generated 85 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 19:01:27.295301 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b8e8a1-a856-42ed-a405-8c03a7efa93c None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:01:27.319111 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c99af8-6cd7-436c-a437-0dd32ff535ae None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:01:27.363594 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a388e5e7-c25e-46d1-af5c-7ccffd01dd7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:01:27.364117 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a388e5e7-c25e-46d1-af5c-7ccffd01dd7e None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:01:27.364393 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a388e5e7-c25e-46d1-af5c-7ccffd01dd7e None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:01:27.364666 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a388e5e7-c25e-46d1-af5c-7ccffd01dd7e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:01:27.415775 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b8e8a1-a856-42ed-a405-8c03a7efa93c None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:01:27.441812 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:01:27.444155 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a388e5e7-c25e-46d1-af5c-7ccffd01dd7e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:01:27.445665 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a388e5e7-c25e-46d1-af5c-7ccffd01dd7e None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:01:27.454931 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8953f09f-bbd6-4fbc-8e40-4e827d2eacb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:01:27.455543 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8953f09f-bbd6-4fbc-8e40-4e827d2eacb9 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:01:27.455824 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8953f09f-bbd6-4fbc-8e40-4e827d2eacb9 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:01:27.456094 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8953f09f-bbd6-4fbc-8e40-4e827d2eacb9 None admin] PATH_INFO: `/v3/users` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:01:27.457179 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8953f09f-bbd6-4fbc-8e40-4e827d2eacb9 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:01:27.457519 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8953f09f-bbd6-4fbc-8e40-4e827d2eacb9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:01:27.459273 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8953f09f-bbd6-4fbc-8e40-4e827d2eacb9 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:01:27.478525 dv-cinder-862365-1-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 222/439] 10.222.0.23 () {56 vars in 1135 bytes} [Fri Oct 28 19:01:27 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:01:27.483931 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8953f09f-bbd6-4fbc-8e40-4e827d2eacb9 None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:01:27.490347 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:01:27.558452 dv-cinder-862365-1-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 218/440] 10.222.0.23 () {58 vars in 1282 bytes} [Fri Oct 28 19:01:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 28 19:01:27.559334 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a388e5e7-c25e-46d1-af5c-7ccffd01dd7e None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:01:27.600549 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8953f09f-bbd6-4fbc-8e40-4e827d2eacb9 None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:01:27.635139 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8315556d-f228-4a84-8fe3-3b55cf40e774 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:01:27.636176 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8315556d-f228-4a84-8fe3-3b55cf40e774 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:01:27.636459 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8315556d-f228-4a84-8fe3-3b55cf40e774 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:01:27.636735 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8315556d-f228-4a84-8fe3-3b55cf40e774 None admin] PATH_INFO: `/v3/roles` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:01:27.637427 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8315556d-f228-4a84-8fe3-3b55cf40e774 None admin] RBAC: Adding query filter params (name=service) {{(pid=81766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:01:27.637734 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8315556d-f228-4a84-8fe3-3b55cf40e774 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:01:27.639487 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8315556d-f228-4a84-8fe3-3b55cf40e774 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:01:27.647285 dv-cinder-862365-1-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 223/441] 10.222.0.23 () {56 vars in 1103 bytes} [Fri Oct 28 19:01:27 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:01:27.648439 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a37da83-e423-4287-b202-483f9d5bf730 None None] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:01:27.648723 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a37da83-e423-4287-b202-483f9d5bf730 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:01:27.649000 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a37da83-e423-4287-b202-483f9d5bf730 None None] PATH_INFO: `/` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:01:27.650267 dv-cinder-862365-1-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 224/442] 10.222.0.23 () {54 vars in 927 bytes} [Fri Oct 28 19:01:27 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 19:01:27.651074 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a37da83-e423-4287-b202-483f9d5bf730 None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:01:27.666390 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a388e5e7-c25e-46d1-af5c-7ccffd01dd7e None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:01:27.696906 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:01:27.700942 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3e0661-d6d0-417b-97f0-8a209fc89307 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:01:27.701592 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3e0661-d6d0-417b-97f0-8a209fc89307 None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:01:27.701873 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3e0661-d6d0-417b-97f0-8a209fc89307 None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:01:27.702145 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3e0661-d6d0-417b-97f0-8a209fc89307 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:01:27.708858 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:01:27.713218 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3e0661-d6d0-417b-97f0-8a209fc89307 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 19:01:27.718598 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application [None req-4e3e0661-d6d0-417b-97f0-8a209fc89307 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 28 19:01:27.718598 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 19:01:27.718598 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 19:01:27.718598 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 19:01:27.718598 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 19:01:27.718598 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 19:01:27.718598 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 19:01:27.718598 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 19:01:27.718598 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 19:01:27.718598 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 19:01:27.718598 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 19:01:27.718598 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 19:01:27.718598 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 28 19:01:27.718598 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 28 19:01:27.718598 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 28 19:01:27.718598 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 28 19:01:27.719684 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 28 19:01:27.719684 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 28 19:01:27.719684 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 28 19:01:27.719684 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 28 19:01:27.719684 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 19:01:27.719684 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 19:01:27.719684 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 19:01:27.719684 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 19:01:27.719684 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 19:01:27.719684 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 19:01:27.719684 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 19:01:27.719684 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application with Lock( Oct 28 19:01:27.719684 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 19:01:27.719684 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._enter() Oct 28 19:01:27.719684 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 19:01:27.719684 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 19:01:27.720866 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 19:01:27.720866 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.creator() Oct 28 19:01:27.720866 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 19:01:27.720866 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application created_value = creator( Oct 28 19:01:27.720866 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 28 19:01:27.720866 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 28 19:01:27.720866 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 28 19:01:27.720866 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 28 19:01:27.720866 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 28 19:01:27.720866 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 28 19:01:27.720866 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 28 19:01:27.720866 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application Oct 28 19:01:27.720866 dv-cinder-862365-1-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 219/443] 10.222.0.23 () {56 vars in 1102 bytes} [Fri Oct 28 19:01:27 2022] GET /identity/v3/roles/service => generated 85 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 19:01:27.721625 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3e0661-d6d0-417b-97f0-8a209fc89307 None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:01:27.754780 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a37da83-e423-4287-b202-483f9d5bf730 None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:01:27.788299 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aec9681-7e06-42e4-b602-a3eace499720 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:01:27.788917 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aec9681-7e06-42e4-b602-a3eace499720 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:01:27.789195 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aec9681-7e06-42e4-b602-a3eace499720 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:01:27.789665 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aec9681-7e06-42e4-b602-a3eace499720 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:01:27.800888 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aec9681-7e06-42e4-b602-a3eace499720 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:01:27.802371 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aec9681-7e06-42e4-b602-a3eace499720 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:01:27.816614 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application [None req-7aec9681-7e06-42e4-b602-a3eace499720 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 19:01:27.816614 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 19:01:27.816614 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 19:01:27.816614 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 19:01:27.816614 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 19:01:27.816614 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 19:01:27.816614 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 19:01:27.816614 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 19:01:27.816614 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 19:01:27.816614 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 19:01:27.816614 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 19:01:27.816614 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 19:01:27.816614 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 28 19:01:27.816614 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 28 19:01:27.816614 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 28 19:01:27.816614 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 28 19:01:27.817735 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 19:01:27.817735 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 19:01:27.817735 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 19:01:27.817735 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 19:01:27.817735 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 19:01:27.817735 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 19:01:27.817735 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 19:01:27.817735 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application with Lock( Oct 28 19:01:27.817735 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 19:01:27.817735 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._enter() Oct 28 19:01:27.817735 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 19:01:27.817735 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 19:01:27.817735 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 19:01:27.817735 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.creator() Oct 28 19:01:27.817735 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 19:01:27.817735 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application created_value = creator( Oct 28 19:01:27.817735 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 28 19:01:27.818837 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 28 19:01:27.818837 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 19:01:27.818837 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Oct 28 19:01:27.818837 dv-cinder-862365-1-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 225/444] 10.222.0.23 () {56 vars in 1108 bytes} [Fri Oct 28 19:01:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 19:01:27.818837 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aec9681-7e06-42e4-b602-a3eace499720 None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:01:27.828103 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3e0661-d6d0-417b-97f0-8a209fc89307 None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:01:27.874435 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5314bfd8-50e7-492c-907f-d6bf984b1bb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:01:27.875062 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5314bfd8-50e7-492c-907f-d6bf984b1bb1 None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:01:27.875341 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5314bfd8-50e7-492c-907f-d6bf984b1bb1 None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:01:27.875612 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5314bfd8-50e7-492c-907f-d6bf984b1bb1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:01:27.885862 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5314bfd8-50e7-492c-907f-d6bf984b1bb1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:01:27.887229 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5314bfd8-50e7-492c-907f-d6bf984b1bb1 None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:01:27.901600 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application [None req-5314bfd8-50e7-492c-907f-d6bf984b1bb1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 19:01:27.901600 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 19:01:27.901600 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 19:01:27.901600 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 19:01:27.901600 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 19:01:27.901600 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 19:01:27.901600 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 19:01:27.901600 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 19:01:27.901600 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 19:01:27.901600 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 19:01:27.901600 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 19:01:27.901600 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 19:01:27.901600 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 28 19:01:27.901600 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 28 19:01:27.901600 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 28 19:01:27.901600 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 28 19:01:27.902478 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 19:01:27.902478 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 19:01:27.902478 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 19:01:27.902478 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 19:01:27.902478 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 19:01:27.902478 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 19:01:27.902478 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 19:01:27.902478 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application with Lock( Oct 28 19:01:27.902478 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 19:01:27.902478 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._enter() Oct 28 19:01:27.902478 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 19:01:27.902478 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 19:01:27.902478 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 19:01:27.902478 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.creator() Oct 28 19:01:27.902478 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 19:01:27.902478 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application created_value = creator( Oct 28 19:01:27.902478 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 28 19:01:27.903309 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 28 19:01:27.903309 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 19:01:27.903309 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application Oct 28 19:01:27.903309 dv-cinder-862365-1-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 220/445] 10.222.0.23 () {56 vars in 1108 bytes} [Fri Oct 28 19:01:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 19:01:27.903831 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6bbc3b-548a-49f0-ad42-7756a88cd218 None None] REQUEST_METHOD: `POST` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:01:27.904122 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6bbc3b-548a-49f0-ad42-7756a88cd218 None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:01:27.904327 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6bbc3b-548a-49f0-ad42-7756a88cd218 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:01:27.922554 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.auth.core [None req-1d6bbc3b-548a-49f0-ad42-7756a88cd218 None None] MFA Rules not processed for user `ae863915635746d1ac19970949de4722`. Rule list: `[]` (Enabled: `True`). {{(pid=81765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:01:27.923803 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-1d6bbc3b-548a-49f0-ad42-7756a88cd218 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:01:27.933850 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:01:27.939745 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aec9681-7e06-42e4-b602-a3eace499720 None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:01:27.969517 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:01:27.971999 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690d3df6-f42e-4115-95c9-b25ca7fe32d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:01:27.972615 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690d3df6-f42e-4115-95c9-b25ca7fe32d4 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:01:27.972899 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690d3df6-f42e-4115-95c9-b25ca7fe32d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:01:27.973161 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690d3df6-f42e-4115-95c9-b25ca7fe32d4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:01:27.983916 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690d3df6-f42e-4115-95c9-b25ca7fe32d4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:01:27.985340 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690d3df6-f42e-4115-95c9-b25ca7fe32d4 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:01:27.991471 dv-cinder-862365-1-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 221/446] 10.222.0.23 () {58 vars in 1024 bytes} [Fri Oct 28 19:01:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 28 19:01:27.992290 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6bbc3b-548a-49f0-ad42-7756a88cd218 None None] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:01:28.012343 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application [None req-690d3df6-f42e-4115-95c9-b25ca7fe32d4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 19:01:28.012343 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 19:01:28.012343 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 19:01:28.012343 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 19:01:28.012343 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 19:01:28.012343 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 19:01:28.012343 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 19:01:28.012343 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 19:01:28.012343 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 19:01:28.012343 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 19:01:28.012343 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 19:01:28.012343 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 19:01:28.012343 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 28 19:01:28.012343 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 28 19:01:28.012343 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 28 19:01:28.012343 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 28 19:01:28.013239 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 19:01:28.013239 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 19:01:28.013239 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 19:01:28.013239 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 19:01:28.013239 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 19:01:28.013239 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 19:01:28.013239 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 19:01:28.013239 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application with Lock( Oct 28 19:01:28.013239 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 19:01:28.013239 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._enter() Oct 28 19:01:28.013239 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 19:01:28.013239 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 19:01:28.013239 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 19:01:28.013239 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.creator() Oct 28 19:01:28.013239 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 19:01:28.013239 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application created_value = creator( Oct 28 19:01:28.013239 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 28 19:01:28.014102 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 28 19:01:28.014102 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 19:01:28.014102 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Oct 28 19:01:28.014102 dv-cinder-862365-1-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 226/447] 10.222.0.23 () {56 vars in 1108 bytes} [Fri Oct 28 19:01:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 19:01:28.014892 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690d3df6-f42e-4115-95c9-b25ca7fe32d4 None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:01:28.096483 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6bbc3b-548a-49f0-ad42-7756a88cd218 None None] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:01:28.119411 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690d3df6-f42e-4115-95c9-b25ca7fe32d4 None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:01:28.133594 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb95179-e5d6-45b4-8b87-86e2c800647a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:01:28.134429 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb95179-e5d6-45b4-8b87-86e2c800647a None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:01:28.134901 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb95179-e5d6-45b4-8b87-86e2c800647a None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:01:28.135468 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb95179-e5d6-45b4-8b87-86e2c800647a None admin] PATH_INFO: `/v3/roles` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:01:28.136450 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb95179-e5d6-45b4-8b87-86e2c800647a None admin] RBAC: Adding query filter params (name=service) {{(pid=81765) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:01:28.136920 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb95179-e5d6-45b4-8b87-86e2c800647a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:01:28.138484 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb95179-e5d6-45b4-8b87-86e2c800647a None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:01:28.147198 dv-cinder-862365-1-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 222/448] 10.222.0.23 () {56 vars in 1103 bytes} [Fri Oct 28 19:01:27 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:01:28.148267 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb95179-e5d6-45b4-8b87-86e2c800647a None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:01:28.157275 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db0bccb-6366-4d01-87bb-610e2454fcaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:01:28.157961 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db0bccb-6366-4d01-87bb-610e2454fcaa None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:01:28.158240 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db0bccb-6366-4d01-87bb-610e2454fcaa None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:01:28.158562 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db0bccb-6366-4d01-87bb-610e2454fcaa None admin] PATH_INFO: `/v3/domains` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:01:28.159203 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db0bccb-6366-4d01-87bb-610e2454fcaa None admin] RBAC: Adding query filter params (name=Default) {{(pid=81766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:01:28.159504 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db0bccb-6366-4d01-87bb-610e2454fcaa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:01:28.160853 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db0bccb-6366-4d01-87bb-610e2454fcaa None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:01:28.177437 dv-cinder-862365-1-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 227/449] 10.222.0.23 () {56 vars in 1109 bytes} [Fri Oct 28 19:01:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:01:28.177437 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db0bccb-6366-4d01-87bb-610e2454fcaa None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:01:28.186487 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:01:28.201650 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:01:28.262321 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb95179-e5d6-45b4-8b87-86e2c800647a None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:01:28.276387 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db0bccb-6366-4d01-87bb-610e2454fcaa None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:01:28.295470 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee6adc5-3cfa-4826-b044-9136b137e922 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:01:28.296065 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee6adc5-3cfa-4826-b044-9136b137e922 None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:01:28.296346 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee6adc5-3cfa-4826-b044-9136b137e922 None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:01:28.296615 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee6adc5-3cfa-4826-b044-9136b137e922 None admin] PATH_INFO: `/v3/domains` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:01:28.297241 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee6adc5-3cfa-4826-b044-9136b137e922 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81765) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:01:28.297568 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee6adc5-3cfa-4826-b044-9136b137e922 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:01:28.298905 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee6adc5-3cfa-4826-b044-9136b137e922 None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:01:28.309655 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7504f799-e3ef-4e0b-8f73-b2453352807d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:01:28.310033 dv-cinder-862365-1-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 223/450] 10.222.0.23 () {56 vars in 1109 bytes} [Fri Oct 28 19:01:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:01:28.313569 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7504f799-e3ef-4e0b-8f73-b2453352807d None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:01:28.313569 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7504f799-e3ef-4e0b-8f73-b2453352807d None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:01:28.313569 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7504f799-e3ef-4e0b-8f73-b2453352807d None admin] PATH_INFO: `/v3/domains` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:01:28.313784 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee6adc5-3cfa-4826-b044-9136b137e922 None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:01:28.313854 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7504f799-e3ef-4e0b-8f73-b2453352807d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:01:28.313854 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7504f799-e3ef-4e0b-8f73-b2453352807d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:01:28.313854 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7504f799-e3ef-4e0b-8f73-b2453352807d None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:01:28.325034 dv-cinder-862365-1-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 228/451] 10.222.0.23 () {56 vars in 1109 bytes} [Fri Oct 28 19:01:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:01:28.325887 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7504f799-e3ef-4e0b-8f73-b2453352807d None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:01:28.389613 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:01:28.410416 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee6adc5-3cfa-4826-b044-9136b137e922 None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:01:28.411991 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:01:28.422387 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7504f799-e3ef-4e0b-8f73-b2453352807d None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:01:28.443870 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396ae93b-0d54-4a06-b722-fa0c70745176 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:01:28.444488 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396ae93b-0d54-4a06-b722-fa0c70745176 None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:01:28.444763 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396ae93b-0d54-4a06-b722-fa0c70745176 None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:01:28.445027 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396ae93b-0d54-4a06-b722-fa0c70745176 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:01:28.454651 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-396ae93b-0d54-4a06-b722-fa0c70745176 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:01:28.454947 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03838df-8003-4302-acb1-1313388465b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:01:28.455568 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03838df-8003-4302-acb1-1313388465b0 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:01:28.455851 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03838df-8003-4302-acb1-1313388465b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:01:28.456083 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-396ae93b-0d54-4a06-b722-fa0c70745176 None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:01:28.456181 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03838df-8003-4302-acb1-1313388465b0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:01:28.462875 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03838df-8003-4302-acb1-1313388465b0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:01:28.464835 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03838df-8003-4302-acb1-1313388465b0 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:01:28.471445 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application [None req-396ae93b-0d54-4a06-b722-fa0c70745176 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 19:01:28.471445 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 19:01:28.471445 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 19:01:28.471445 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 19:01:28.471445 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 19:01:28.471445 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 19:01:28.471445 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 19:01:28.471445 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 19:01:28.471445 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 19:01:28.471445 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 19:01:28.471445 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 19:01:28.471445 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 19:01:28.471445 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 28 19:01:28.471445 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 28 19:01:28.471445 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 28 19:01:28.471445 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 28 19:01:28.472364 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 19:01:28.472364 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 19:01:28.472364 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 19:01:28.472364 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 19:01:28.472364 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 19:01:28.472364 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 19:01:28.472364 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 19:01:28.472364 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application with Lock( Oct 28 19:01:28.472364 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 19:01:28.472364 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._enter() Oct 28 19:01:28.472364 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 19:01:28.472364 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 19:01:28.472364 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 19:01:28.472364 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.creator() Oct 28 19:01:28.472364 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 19:01:28.472364 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application created_value = creator( Oct 28 19:01:28.472364 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 28 19:01:28.473191 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 28 19:01:28.473191 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 19:01:28.473191 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application Oct 28 19:01:28.473191 dv-cinder-862365-1-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 224/452] 10.222.0.23 () {56 vars in 1108 bytes} [Fri Oct 28 19:01:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 19:01:28.473477 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396ae93b-0d54-4a06-b722-fa0c70745176 None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:01:28.475918 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application [None req-e03838df-8003-4302-acb1-1313388465b0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 28 19:01:28.475918 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 19:01:28.475918 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 19:01:28.475918 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 19:01:28.475918 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 19:01:28.475918 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 19:01:28.475918 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 19:01:28.475918 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 19:01:28.475918 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 19:01:28.475918 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 19:01:28.475918 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 19:01:28.475918 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 19:01:28.475918 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 28 19:01:28.475918 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 28 19:01:28.475918 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 28 19:01:28.476727 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 28 19:01:28.476727 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 19:01:28.476727 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 19:01:28.476727 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 19:01:28.476727 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 19:01:28.476727 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 19:01:28.476727 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 19:01:28.476727 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 19:01:28.476727 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application with Lock( Oct 28 19:01:28.476727 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 19:01:28.476727 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._enter() Oct 28 19:01:28.476727 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 19:01:28.476727 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 19:01:28.476727 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 19:01:28.476727 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.creator() Oct 28 19:01:28.476727 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 19:01:28.476727 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application created_value = creator( Oct 28 19:01:28.477597 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 28 19:01:28.477597 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 28 19:01:28.477597 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 28 19:01:28.477597 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 28 19:01:28.477597 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 28 19:01:28.477597 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 28 19:01:28.477597 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 28 19:01:28.477597 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Oct 28 19:01:28.477597 dv-cinder-862365-1-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 229/453] 10.222.0.23 () {56 vars in 1111 bytes} [Fri Oct 28 19:01:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 19:01:28.478046 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03838df-8003-4302-acb1-1313388465b0 None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:01:28.574989 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03838df-8003-4302-acb1-1313388465b0 None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:01:28.577086 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396ae93b-0d54-4a06-b722-fa0c70745176 None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:01:28.602721 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:01:28.610679 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82face6c-0912-4fd6-9e86-bae5b387db0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:01:28.611125 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260a9ea4-8c7a-4305-9422-374a1fece8d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:01:28.611300 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82face6c-0912-4fd6-9e86-bae5b387db0d None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:01:28.615102 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82face6c-0912-4fd6-9e86-bae5b387db0d None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:01:28.615268 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260a9ea4-8c7a-4305-9422-374a1fece8d5 None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:01:28.615370 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82face6c-0912-4fd6-9e86-bae5b387db0d None admin] PATH_INFO: `/v3/projects/service` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:01:28.615457 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260a9ea4-8c7a-4305-9422-374a1fece8d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:01:28.615457 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260a9ea4-8c7a-4305-9422-374a1fece8d5 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:01:28.618244 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82face6c-0912-4fd6-9e86-bae5b387db0d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:01:28.619726 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82face6c-0912-4fd6-9e86-bae5b387db0d None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:01:28.622189 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260a9ea4-8c7a-4305-9422-374a1fece8d5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 19:01:28.628265 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application [None req-260a9ea4-8c7a-4305-9422-374a1fece8d5 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 28 19:01:28.628265 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 19:01:28.628265 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 19:01:28.628265 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 19:01:28.628265 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 19:01:28.628265 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 19:01:28.628265 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 19:01:28.628265 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 19:01:28.628265 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 19:01:28.628265 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 19:01:28.628265 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 19:01:28.628265 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 19:01:28.628265 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 28 19:01:28.628265 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 28 19:01:28.628265 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 28 19:01:28.628265 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 28 19:01:28.629310 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 28 19:01:28.629310 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 28 19:01:28.629310 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 28 19:01:28.629310 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 28 19:01:28.629310 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 19:01:28.629310 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 19:01:28.629310 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 19:01:28.629310 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 19:01:28.629310 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 19:01:28.629310 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 19:01:28.629310 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 19:01:28.629310 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application with Lock( Oct 28 19:01:28.629310 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 19:01:28.629310 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._enter() Oct 28 19:01:28.629310 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 19:01:28.629310 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 19:01:28.630173 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 19:01:28.630173 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.creator() Oct 28 19:01:28.630173 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 19:01:28.630173 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application created_value = creator( Oct 28 19:01:28.630173 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 28 19:01:28.630173 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 28 19:01:28.630173 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 28 19:01:28.630173 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 28 19:01:28.630173 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 28 19:01:28.630173 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 28 19:01:28.630173 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 28 19:01:28.630173 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application Oct 28 19:01:28.630173 dv-cinder-862365-1-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 225/454] 10.222.0.23 () {56 vars in 1102 bytes} [Fri Oct 28 19:01:28 2022] GET /identity/v3/roles/service => generated 85 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 19:01:28.630173 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260a9ea4-8c7a-4305-9422-374a1fece8d5 None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:01:28.630902 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application [None req-82face6c-0912-4fd6-9e86-bae5b387db0d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 28 19:01:28.630902 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 19:01:28.630902 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 19:01:28.630902 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 19:01:28.630902 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 19:01:28.630902 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 19:01:28.630902 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 19:01:28.630902 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 19:01:28.630902 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 19:01:28.630902 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 19:01:28.630902 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 19:01:28.630902 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 19:01:28.630902 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 28 19:01:28.630902 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 28 19:01:28.630902 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 28 19:01:28.631627 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 28 19:01:28.631627 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 19:01:28.631627 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 19:01:28.631627 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 19:01:28.631627 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 19:01:28.631627 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 19:01:28.631627 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 19:01:28.631627 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 19:01:28.631627 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application with Lock( Oct 28 19:01:28.631627 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 19:01:28.631627 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._enter() Oct 28 19:01:28.631627 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 19:01:28.631627 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 19:01:28.631627 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 19:01:28.631627 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.creator() Oct 28 19:01:28.631627 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 19:01:28.631627 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application created_value = creator( Oct 28 19:01:28.632445 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 28 19:01:28.632445 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 28 19:01:28.632445 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 28 19:01:28.632445 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 28 19:01:28.632445 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 28 19:01:28.632445 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 28 19:01:28.632445 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 28 19:01:28.632445 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Oct 28 19:01:28.632445 dv-cinder-862365-1-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 230/455] 10.222.0.23 () {56 vars in 1111 bytes} [Fri Oct 28 19:01:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 19:01:28.632892 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82face6c-0912-4fd6-9e86-bae5b387db0d None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:01:28.649963 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:01:28.731378 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82face6c-0912-4fd6-9e86-bae5b387db0d None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:01:28.734132 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260a9ea4-8c7a-4305-9422-374a1fece8d5 None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:01:28.764434 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce98aad-6b5e-419a-b911-6911e2d8b4b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:01:28.765030 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce98aad-6b5e-419a-b911-6911e2d8b4b1 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:01:28.765308 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce98aad-6b5e-419a-b911-6911e2d8b4b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:01:28.765608 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce98aad-6b5e-419a-b911-6911e2d8b4b1 None admin] PATH_INFO: `/v3/domains` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:01:28.766233 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce98aad-6b5e-419a-b911-6911e2d8b4b1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:01:28.766532 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce98aad-6b5e-419a-b911-6911e2d8b4b1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:01:28.766958 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a3e719-543f-4160-8c83-fb44b8c080e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:01:28.767578 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a3e719-543f-4160-8c83-fb44b8c080e8 None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:01:28.767860 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a3e719-543f-4160-8c83-fb44b8c080e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:01:28.767958 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce98aad-6b5e-419a-b911-6911e2d8b4b1 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:01:28.768133 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a3e719-543f-4160-8c83-fb44b8c080e8 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:01:28.775819 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a3e719-543f-4160-8c83-fb44b8c080e8 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:01:28.777794 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a3e719-543f-4160-8c83-fb44b8c080e8 None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:01:28.779940 dv-cinder-862365-1-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 231/456] 10.222.0.23 () {56 vars in 1109 bytes} [Fri Oct 28 19:01:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:01:28.780730 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce98aad-6b5e-419a-b911-6911e2d8b4b1 None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:01:28.789940 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application [None req-54a3e719-543f-4160-8c83-fb44b8c080e8 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Oct 28 19:01:28.789940 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 19:01:28.789940 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 19:01:28.789940 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 19:01:28.789940 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 19:01:28.789940 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 19:01:28.789940 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 19:01:28.789940 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 19:01:28.789940 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 19:01:28.789940 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 19:01:28.789940 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 19:01:28.789940 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 19:01:28.789940 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 28 19:01:28.789940 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 28 19:01:28.789940 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 28 19:01:28.789940 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 28 19:01:28.796040 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 19:01:28.796040 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 19:01:28.796040 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 28 19:01:28.796040 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 28 19:01:28.796040 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 28 19:01:28.796040 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 28 19:01:28.796040 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 19:01:28.796040 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 19:01:28.796040 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 19:01:28.796040 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 19:01:28.796040 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 19:01:28.796040 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application with Lock( Oct 28 19:01:28.796040 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 19:01:28.796040 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._enter() Oct 28 19:01:28.796040 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 19:01:28.796040 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 19:01:28.796040 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 19:01:28.796040 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.creator() Oct 28 19:01:28.797095 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 19:01:28.797095 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application created_value = creator( Oct 28 19:01:28.797095 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 28 19:01:28.797095 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 28 19:01:28.797095 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 28 19:01:28.797095 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 28 19:01:28.797095 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 28 19:01:28.797095 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 28 19:01:28.797095 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Oct 28 19:01:28.797095 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application Oct 28 19:01:28.797095 dv-cinder-862365-1-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 226/457] 10.222.0.23 () {56 vars in 1099 bytes} [Fri Oct 28 19:01:28 2022] GET /identity/v3/users/cinder => generated 84 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 19:01:28.797095 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a3e719-543f-4160-8c83-fb44b8c080e8 None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:01:28.836805 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:01:28.866457 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:01:28.887848 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce98aad-6b5e-419a-b911-6911e2d8b4b1 None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:01:28.890827 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a3e719-543f-4160-8c83-fb44b8c080e8 None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:01:28.921864 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c1d024-a3e6-4bec-8e9e-8567aaf3fc9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:01:28.922410 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c1d024-a3e6-4bec-8e9e-8567aaf3fc9e None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:01:28.922691 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c1d024-a3e6-4bec-8e9e-8567aaf3fc9e None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:01:28.922967 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c1d024-a3e6-4bec-8e9e-8567aaf3fc9e None admin] PATH_INFO: `/v3/projects` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:01:28.923651 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c1d024-a3e6-4bec-8e9e-8567aaf3fc9e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:01:28.923959 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c1d024-a3e6-4bec-8e9e-8567aaf3fc9e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:01:28.925338 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be869f55-c8a9-4522-99b9-4563d2617dda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:01:28.925474 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c1d024-a3e6-4bec-8e9e-8567aaf3fc9e None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:01:28.925959 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be869f55-c8a9-4522-99b9-4563d2617dda None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:01:28.926239 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be869f55-c8a9-4522-99b9-4563d2617dda None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:01:28.926510 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be869f55-c8a9-4522-99b9-4563d2617dda None admin] PATH_INFO: `/v3/roles` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:01:28.927158 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be869f55-c8a9-4522-99b9-4563d2617dda None admin] RBAC: Adding query filter params (name=service) {{(pid=81765) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:01:28.927455 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be869f55-c8a9-4522-99b9-4563d2617dda None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:01:28.928800 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be869f55-c8a9-4522-99b9-4563d2617dda None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:01:28.936609 dv-cinder-862365-1-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 232/458] 10.222.0.23 () {56 vars in 1148 bytes} [Fri Oct 28 19:01:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:01:28.936884 dv-cinder-862365-1-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 227/459] 10.222.0.23 () {56 vars in 1103 bytes} [Fri Oct 28 19:01:28 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:01:28.937754 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be869f55-c8a9-4522-99b9-4563d2617dda None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:01:28.937853 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c1d024-a3e6-4bec-8e9e-8567aaf3fc9e None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:01:29.036020 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be869f55-c8a9-4522-99b9-4563d2617dda None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:01:29.039281 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c1d024-a3e6-4bec-8e9e-8567aaf3fc9e None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:01:29.047811 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:01:29.068567 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386a882f-7faa-40f2-828b-553f86acecd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:01:29.069191 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386a882f-7faa-40f2-828b-553f86acecd1 None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:01:29.069516 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386a882f-7faa-40f2-828b-553f86acecd1 None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:01:29.069794 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386a882f-7faa-40f2-828b-553f86acecd1 None admin] PATH_INFO: `/v3/users/glance` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:01:29.071742 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9749b7a-af37-447c-952a-f9391a9a9e5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:01:29.072340 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9749b7a-af37-447c-952a-f9391a9a9e5d None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:01:29.072460 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:01:29.072671 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9749b7a-af37-447c-952a-f9391a9a9e5d None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:01:29.073478 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9749b7a-af37-447c-952a-f9391a9a9e5d None admin] PATH_INFO: `/v3/projects` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:01:29.074158 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9749b7a-af37-447c-952a-f9391a9a9e5d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:01:29.074463 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9749b7a-af37-447c-952a-f9391a9a9e5d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:01:29.075931 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9749b7a-af37-447c-952a-f9391a9a9e5d None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:01:29.077997 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-386a882f-7faa-40f2-828b-553f86acecd1 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:01:29.079407 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-386a882f-7faa-40f2-828b-553f86acecd1 None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:01:29.088516 dv-cinder-862365-1-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 233/460] 10.222.0.23 () {56 vars in 1148 bytes} [Fri Oct 28 19:01:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:01:29.089300 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9749b7a-af37-447c-952a-f9391a9a9e5d None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:01:29.090752 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application [None req-386a882f-7faa-40f2-828b-553f86acecd1 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Oct 28 19:01:29.090752 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 19:01:29.090752 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 19:01:29.090752 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 19:01:29.090752 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 19:01:29.090752 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 19:01:29.090752 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 19:01:29.090752 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 19:01:29.090752 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 19:01:29.090752 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 19:01:29.090752 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 19:01:29.090752 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 19:01:29.090752 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 28 19:01:29.090752 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 28 19:01:29.090752 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 28 19:01:29.090752 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 28 19:01:29.091602 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 19:01:29.091602 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 19:01:29.091602 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 28 19:01:29.091602 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 28 19:01:29.091602 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 28 19:01:29.091602 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 28 19:01:29.091602 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 19:01:29.091602 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 19:01:29.091602 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 19:01:29.091602 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 19:01:29.091602 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 19:01:29.091602 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application with Lock( Oct 28 19:01:29.091602 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 19:01:29.091602 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._enter() Oct 28 19:01:29.091602 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 19:01:29.091602 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 19:01:29.091602 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 19:01:29.091602 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.creator() Oct 28 19:01:29.092476 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 19:01:29.092476 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application created_value = creator( Oct 28 19:01:29.092476 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 28 19:01:29.092476 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 28 19:01:29.092476 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 28 19:01:29.092476 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 28 19:01:29.092476 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 28 19:01:29.092476 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 28 19:01:29.092476 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Oct 28 19:01:29.092476 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application Oct 28 19:01:29.092476 dv-cinder-862365-1-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 228/461] 10.222.0.23 () {56 vars in 1099 bytes} [Fri Oct 28 19:01:28 2022] GET /identity/v3/users/glance => generated 84 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 19:01:29.093015 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386a882f-7faa-40f2-828b-553f86acecd1 None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:01:29.187882 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9749b7a-af37-447c-952a-f9391a9a9e5d None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:01:29.191579 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386a882f-7faa-40f2-828b-553f86acecd1 None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:01:29.222042 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a64537-5153-4053-bc53-86d2f838ae2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:01:29.222641 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a64537-5153-4053-bc53-86d2f838ae2a None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:01:29.222916 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a64537-5153-4053-bc53-86d2f838ae2a None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:01:29.223194 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a64537-5153-4053-bc53-86d2f838ae2a None admin] PATH_INFO: `/v3/users` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:01:29.223894 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a64537-5153-4053-bc53-86d2f838ae2a None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:01:29.224222 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a64537-5153-4053-bc53-86d2f838ae2a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:01:29.225043 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e8d845-c80c-4fa2-aef8-017063d87939 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:01:29.225669 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a64537-5153-4053-bc53-86d2f838ae2a None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:01:29.225788 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e8d845-c80c-4fa2-aef8-017063d87939 None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:01:29.225955 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e8d845-c80c-4fa2-aef8-017063d87939 None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:01:29.226226 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e8d845-c80c-4fa2-aef8-017063d87939 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:01:29.237245 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e8d845-c80c-4fa2-aef8-017063d87939 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:01:29.238685 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e8d845-c80c-4fa2-aef8-017063d87939 None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:01:29.242263 dv-cinder-862365-1-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 234/462] 10.222.0.23 () {56 vars in 1137 bytes} [Fri Oct 28 19:01:29 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:01:29.243022 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a64537-5153-4053-bc53-86d2f838ae2a None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:01:29.253256 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application [None req-99e8d845-c80c-4fa2-aef8-017063d87939 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 19:01:29.253256 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 19:01:29.253256 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 19:01:29.253256 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 19:01:29.253256 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 19:01:29.253256 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 19:01:29.253256 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 19:01:29.253256 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 19:01:29.253256 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 19:01:29.253256 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 19:01:29.253256 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 19:01:29.253256 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 19:01:29.253256 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 28 19:01:29.253256 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 28 19:01:29.253256 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 28 19:01:29.253256 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 28 19:01:29.254229 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 19:01:29.254229 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 19:01:29.254229 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 19:01:29.254229 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 19:01:29.254229 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 19:01:29.254229 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 19:01:29.254229 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 19:01:29.254229 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application with Lock( Oct 28 19:01:29.254229 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 19:01:29.254229 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._enter() Oct 28 19:01:29.254229 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 19:01:29.254229 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 19:01:29.254229 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 19:01:29.254229 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.creator() Oct 28 19:01:29.254229 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 19:01:29.254229 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application created_value = creator( Oct 28 19:01:29.254229 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 28 19:01:29.255063 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 28 19:01:29.255063 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 19:01:29.255063 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application Oct 28 19:01:29.255063 dv-cinder-862365-1-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 229/463] 10.222.0.23 () {56 vars in 1108 bytes} [Fri Oct 28 19:01:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 19:01:29.255284 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e8d845-c80c-4fa2-aef8-017063d87939 None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:01:29.274089 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:01:29.306780 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:01:29.345798 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a64537-5153-4053-bc53-86d2f838ae2a None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:01:29.358065 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e8d845-c80c-4fa2-aef8-017063d87939 None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:01:29.378810 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01453def-8930-48d9-aae7-3627b04ee893 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:01:29.379464 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01453def-8930-48d9-aae7-3627b04ee893 None admin] REQUEST_METHOD: `PUT` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:01:29.379753 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01453def-8930-48d9-aae7-3627b04ee893 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:01:29.380029 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01453def-8930-48d9-aae7-3627b04ee893 None admin] PATH_INFO: `/v3/projects/b705897907f042c0818a931052438e1e/users/ddd2863f2113472cb20577990b5c55d7/roles/068b73485c0e46cb8a8d88b948028746` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:01:29.390557 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d08f72-44dc-42c6-a536-bd09fc224411 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:01:29.391147 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d08f72-44dc-42c6-a536-bd09fc224411 None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:01:29.391429 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d08f72-44dc-42c6-a536-bd09fc224411 None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:01:29.391695 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d08f72-44dc-42c6-a536-bd09fc224411 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:01:29.392407 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d08f72-44dc-42c6-a536-bd09fc224411 None admin] RBAC: Adding query filter params (role.id=068b73485c0e46cb8a8d88b948028746, scope.project.id=b705897907f042c0818a931052438e1e, user.id=8877180cd9844dad8b0980de34769ec8) {{(pid=81765) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:01:29.392713 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d08f72-44dc-42c6-a536-bd09fc224411 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:01:29.394025 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01453def-8930-48d9-aae7-3627b04ee893 None admin] RBAC: Authorizing `identity:create_grant(project_id=b705897907f042c0818a931052438e1e, user_id=ddd2863f2113472cb20577990b5c55d7, role_id=068b73485c0e46cb8a8d88b948028746)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:01:29.394161 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d08f72-44dc-42c6-a536-bd09fc224411 None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:01:29.395539 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01453def-8930-48d9-aae7-3627b04ee893 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:01:29.399719 dv-cinder-862365-1-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 230/464] 10.222.0.23 () {56 vars in 1374 bytes} [Fri Oct 28 19:01:29 2022] GET /identity/v3/role_assignments?user.id=8877180cd9844dad8b0980de34769ec8&scope.project.id=b705897907f042c0818a931052438e1e&role.id=068b73485c0e46cb8a8d88b948028746 => generated 608 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:01:29.400525 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d08f72-44dc-42c6-a536-bd09fc224411 None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:01:29.476817 dv-cinder-862365-1-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 235/465] 10.222.0.23 () {58 vars in 1439 bytes} [Fri Oct 28 19:01:29 2022] PUT /identity/v3/projects/b705897907f042c0818a931052438e1e/users/ddd2863f2113472cb20577990b5c55d7/roles/068b73485c0e46cb8a8d88b948028746 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 19:01:29.478395 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01453def-8930-48d9-aae7-3627b04ee893 None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:01:29.522891 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d08f72-44dc-42c6-a536-bd09fc224411 None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:01:29.545379 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:01:29.575592 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b443560e-81fa-4b40-8383-8d195ff1a051 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:01:29.576220 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b443560e-81fa-4b40-8383-8d195ff1a051 None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:01:29.576504 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b443560e-81fa-4b40-8383-8d195ff1a051 None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:01:29.576780 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b443560e-81fa-4b40-8383-8d195ff1a051 None admin] PATH_INFO: `/v3/users` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:01:29.577671 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b443560e-81fa-4b40-8383-8d195ff1a051 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81765) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:01:29.578090 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b443560e-81fa-4b40-8383-8d195ff1a051 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:01:29.580380 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b443560e-81fa-4b40-8383-8d195ff1a051 None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:01:29.601226 dv-cinder-862365-1-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 231/466] 10.222.0.23 () {56 vars in 1137 bytes} [Fri Oct 28 19:01:29 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:01:29.602352 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b443560e-81fa-4b40-8383-8d195ff1a051 None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:01:29.604649 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:01:29.637261 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01453def-8930-48d9-aae7-3627b04ee893 None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:01:29.690757 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113950de-5577-4409-bee9-dab17ee0cb1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:01:29.691502 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113950de-5577-4409-bee9-dab17ee0cb1b None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:01:29.691870 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113950de-5577-4409-bee9-dab17ee0cb1b None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:01:29.692223 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113950de-5577-4409-bee9-dab17ee0cb1b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:01:29.725955 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b443560e-81fa-4b40-8383-8d195ff1a051 None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:01:29.770310 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0a3e87-064d-45cb-903a-ea3896a5e40e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:01:29.770922 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0a3e87-064d-45cb-903a-ea3896a5e40e None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:01:29.771209 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0a3e87-064d-45cb-903a-ea3896a5e40e None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:01:29.771485 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0a3e87-064d-45cb-903a-ea3896a5e40e None admin] PATH_INFO: `/v3/domains` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:01:29.772197 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0a3e87-064d-45cb-903a-ea3896a5e40e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81765) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:01:29.772506 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0a3e87-064d-45cb-903a-ea3896a5e40e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:01:29.773920 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0a3e87-064d-45cb-903a-ea3896a5e40e None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:01:29.786776 dv-cinder-862365-1-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 232/467] 10.222.0.23 () {56 vars in 1109 bytes} [Fri Oct 28 19:01:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:01:29.787620 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0a3e87-064d-45cb-903a-ea3896a5e40e None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:01:29.787750 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113950de-5577-4409-bee9-dab17ee0cb1b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:01:29.789162 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113950de-5577-4409-bee9-dab17ee0cb1b None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:01:29.831743 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:01:29.878113 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:01:29.903477 dv-cinder-862365-1-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 236/468] 10.222.0.23 () {58 vars in 1282 bytes} [Fri Oct 28 19:01:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 425 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 28 19:01:29.905377 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113950de-5577-4409-bee9-dab17ee0cb1b None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:01:29.936102 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0a3e87-064d-45cb-903a-ea3896a5e40e None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:01:29.980658 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61f70cd-e795-4721-8ade-c29601a30f96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:01:29.981271 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61f70cd-e795-4721-8ade-c29601a30f96 None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:01:29.981581 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61f70cd-e795-4721-8ade-c29601a30f96 None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:01:29.981853 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61f70cd-e795-4721-8ade-c29601a30f96 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:01:30.016386 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113950de-5577-4409-bee9-dab17ee0cb1b None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:01:30.054035 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aec73cd-1afd-49b4-8811-6429b0a48223 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:01:30.054591 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aec73cd-1afd-49b4-8811-6429b0a48223 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:01:30.054871 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aec73cd-1afd-49b4-8811-6429b0a48223 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:01:30.055140 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aec73cd-1afd-49b4-8811-6429b0a48223 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:01:30.063368 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aec73cd-1afd-49b4-8811-6429b0a48223 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:01:30.064837 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aec73cd-1afd-49b4-8811-6429b0a48223 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:01:30.068966 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61f70cd-e795-4721-8ade-c29601a30f96 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:01:30.070497 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61f70cd-e795-4721-8ade-c29601a30f96 None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:01:30.078025 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application [None req-0aec73cd-1afd-49b4-8811-6429b0a48223 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Oct 28 19:01:30.078025 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 19:01:30.078025 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 19:01:30.078025 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 19:01:30.078025 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 19:01:30.078025 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 19:01:30.078025 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 19:01:30.078025 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 19:01:30.078025 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 19:01:30.078025 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 19:01:30.078025 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 19:01:30.078025 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 19:01:30.078025 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 28 19:01:30.078025 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 28 19:01:30.078025 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 28 19:01:30.078025 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 28 19:01:30.080148 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 19:01:30.080148 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 19:01:30.080148 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 28 19:01:30.080148 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 28 19:01:30.080148 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 28 19:01:30.080148 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 28 19:01:30.080148 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 19:01:30.080148 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 19:01:30.080148 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 19:01:30.080148 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 19:01:30.080148 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 19:01:30.080148 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application with Lock( Oct 28 19:01:30.080148 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 19:01:30.080148 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._enter() Oct 28 19:01:30.080148 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 19:01:30.080148 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 19:01:30.080148 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 19:01:30.080148 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.creator() Oct 28 19:01:30.081495 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 19:01:30.081495 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application created_value = creator( Oct 28 19:01:30.081495 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 28 19:01:30.081495 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 28 19:01:30.081495 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 28 19:01:30.081495 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 28 19:01:30.081495 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 28 19:01:30.081495 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 28 19:01:30.081495 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Oct 28 19:01:30.081495 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Oct 28 19:01:30.081495 dv-cinder-862365-1-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 237/469] 10.222.0.23 () {56 vars in 1102 bytes} [Fri Oct 28 19:01:29 2022] GET /identity/v3/users/neutron => generated 85 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 19:01:30.081495 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aec73cd-1afd-49b4-8811-6429b0a48223 None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:01:30.112247 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:01:30.121786 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:01:30.188333 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aec73cd-1afd-49b4-8811-6429b0a48223 None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:01:30.213890 dv-cinder-862365-1-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 233/470] 10.222.0.23 () {58 vars in 1282 bytes} [Fri Oct 28 19:01:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 427 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 28 19:01:30.215880 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61f70cd-e795-4721-8ade-c29601a30f96 None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:01:30.229991 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70cad205-f7bb-4a77-803c-542bbe00d412 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:01:30.230626 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cad205-f7bb-4a77-803c-542bbe00d412 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:01:30.230909 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cad205-f7bb-4a77-803c-542bbe00d412 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:01:30.231185 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cad205-f7bb-4a77-803c-542bbe00d412 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:01:30.242519 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70cad205-f7bb-4a77-803c-542bbe00d412 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:01:30.243990 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70cad205-f7bb-4a77-803c-542bbe00d412 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:01:30.258903 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application [None req-70cad205-f7bb-4a77-803c-542bbe00d412 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 19:01:30.258903 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 19:01:30.258903 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 19:01:30.258903 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 19:01:30.258903 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 19:01:30.258903 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 19:01:30.258903 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 19:01:30.258903 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 19:01:30.258903 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 19:01:30.258903 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 19:01:30.258903 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 19:01:30.258903 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 19:01:30.258903 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 28 19:01:30.258903 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 28 19:01:30.258903 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 28 19:01:30.258903 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 28 19:01:30.259838 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 19:01:30.259838 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 19:01:30.259838 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 19:01:30.259838 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 19:01:30.259838 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 19:01:30.259838 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 19:01:30.259838 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 19:01:30.259838 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application with Lock( Oct 28 19:01:30.259838 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 19:01:30.259838 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._enter() Oct 28 19:01:30.259838 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 19:01:30.259838 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 19:01:30.259838 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 19:01:30.259838 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.creator() Oct 28 19:01:30.259838 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 19:01:30.259838 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application created_value = creator( Oct 28 19:01:30.259838 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 28 19:01:30.261256 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 28 19:01:30.261256 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 19:01:30.261256 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Oct 28 19:01:30.265172 dv-cinder-862365-1-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 238/471] 10.222.0.23 () {56 vars in 1108 bytes} [Fri Oct 28 19:01:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 19:01:30.266082 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70cad205-f7bb-4a77-803c-542bbe00d412 None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:01:30.333852 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61f70cd-e795-4721-8ade-c29601a30f96 None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:01:30.367824 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:01:30.373733 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03276a9d-8fbc-4fcb-9538-6213e7a7ec7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:01:30.374342 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03276a9d-8fbc-4fcb-9538-6213e7a7ec7f None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:01:30.374620 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03276a9d-8fbc-4fcb-9538-6213e7a7ec7f None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:01:30.375107 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03276a9d-8fbc-4fcb-9538-6213e7a7ec7f None admin] PATH_INFO: `/v3/users` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:01:30.383193 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03276a9d-8fbc-4fcb-9538-6213e7a7ec7f None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81765) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:01:30.383193 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03276a9d-8fbc-4fcb-9538-6213e7a7ec7f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:01:30.383193 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03276a9d-8fbc-4fcb-9538-6213e7a7ec7f None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:01:30.383485 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70cad205-f7bb-4a77-803c-542bbe00d412 None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:01:30.399575 dv-cinder-862365-1-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 234/472] 10.222.0.23 () {56 vars in 1139 bytes} [Fri Oct 28 19:01:30 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:01:30.401434 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03276a9d-8fbc-4fcb-9538-6213e7a7ec7f None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:01:30.422326 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c1b222-c867-42db-a811-9b407a8247f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:01:30.423667 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c1b222-c867-42db-a811-9b407a8247f3 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:01:30.424153 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c1b222-c867-42db-a811-9b407a8247f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:01:30.424624 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c1b222-c867-42db-a811-9b407a8247f3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:01:30.439530 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c1b222-c867-42db-a811-9b407a8247f3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:01:30.442351 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c1b222-c867-42db-a811-9b407a8247f3 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:01:30.453714 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:01:30.462467 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application [None req-43c1b222-c867-42db-a811-9b407a8247f3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 19:01:30.462467 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 19:01:30.462467 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 19:01:30.462467 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 19:01:30.462467 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 19:01:30.462467 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 19:01:30.462467 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 19:01:30.462467 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 19:01:30.462467 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 19:01:30.462467 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 19:01:30.462467 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 19:01:30.462467 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 19:01:30.462467 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 28 19:01:30.462467 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 28 19:01:30.462467 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 28 19:01:30.462467 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 28 19:01:30.463954 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 19:01:30.463954 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 19:01:30.463954 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 19:01:30.463954 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 19:01:30.463954 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 19:01:30.463954 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 19:01:30.463954 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 19:01:30.463954 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application with Lock( Oct 28 19:01:30.463954 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 19:01:30.463954 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._enter() Oct 28 19:01:30.463954 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 19:01:30.463954 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 19:01:30.463954 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 19:01:30.463954 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.creator() Oct 28 19:01:30.463954 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 19:01:30.463954 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application created_value = creator( Oct 28 19:01:30.463954 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 28 19:01:30.464783 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 28 19:01:30.464783 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 19:01:30.464783 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Oct 28 19:01:30.467383 dv-cinder-862365-1-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 239/473] 10.222.0.23 () {56 vars in 1108 bytes} [Fri Oct 28 19:01:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 19:01:30.468344 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c1b222-c867-42db-a811-9b407a8247f3 None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:01:30.526679 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03276a9d-8fbc-4fcb-9538-6213e7a7ec7f None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:01:30.567588 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b3ee1c-5a04-47ba-948b-4de3ebbf94c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:01:30.568187 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b3ee1c-5a04-47ba-948b-4de3ebbf94c4 None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:01:30.568477 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b3ee1c-5a04-47ba-948b-4de3ebbf94c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:01:30.569026 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b3ee1c-5a04-47ba-948b-4de3ebbf94c4 None admin] PATH_INFO: `/v3/domains` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:01:30.569443 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b3ee1c-5a04-47ba-948b-4de3ebbf94c4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81765) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:01:30.569743 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b3ee1c-5a04-47ba-948b-4de3ebbf94c4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:01:30.571139 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b3ee1c-5a04-47ba-948b-4de3ebbf94c4 None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:01:30.589475 dv-cinder-862365-1-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 235/474] 10.222.0.23 () {56 vars in 1109 bytes} [Fri Oct 28 19:01:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:01:30.589475 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b3ee1c-5a04-47ba-948b-4de3ebbf94c4 None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:01:30.610971 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c1b222-c867-42db-a811-9b407a8247f3 None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:01:30.643065 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:01:30.658571 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc28883-8130-4686-b9c1-b11d9421d489 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:01:30.659633 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc28883-8130-4686-b9c1-b11d9421d489 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:01:30.659986 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc28883-8130-4686-b9c1-b11d9421d489 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:01:30.660333 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc28883-8130-4686-b9c1-b11d9421d489 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:01:30.674015 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:01:30.701192 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b3ee1c-5a04-47ba-948b-4de3ebbf94c4 None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:01:30.741016 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bfa0e78-451c-4871-b850-a1ad13b33299 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:01:30.741909 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfa0e78-451c-4871-b850-a1ad13b33299 None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:01:30.742324 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfa0e78-451c-4871-b850-a1ad13b33299 None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:01:30.742731 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfa0e78-451c-4871-b850-a1ad13b33299 None admin] PATH_INFO: `/v3/domains` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:01:30.743500 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bfa0e78-451c-4871-b850-a1ad13b33299 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81765) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:01:30.743952 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bfa0e78-451c-4871-b850-a1ad13b33299 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:01:30.746155 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bfa0e78-451c-4871-b850-a1ad13b33299 None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:01:30.750914 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc28883-8130-4686-b9c1-b11d9421d489 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:01:30.752525 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc28883-8130-4686-b9c1-b11d9421d489 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:01:30.763660 dv-cinder-862365-1-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 236/475] 10.222.0.23 () {56 vars in 1109 bytes} [Fri Oct 28 19:01:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:01:30.764737 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bfa0e78-451c-4871-b850-a1ad13b33299 None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:01:30.875064 dv-cinder-862365-1-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 240/476] 10.222.0.23 () {58 vars in 1282 bytes} [Fri Oct 28 19:01:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 402 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 28 19:01:30.876348 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc28883-8130-4686-b9c1-b11d9421d489 None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:01:30.893560 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bfa0e78-451c-4871-b850-a1ad13b33299 None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:01:30.905495 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:01:30.922340 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:01:30.938697 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee9fc75-6b04-48c1-8b69-4c6f1966b81c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:01:30.939499 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee9fc75-6b04-48c1-8b69-4c6f1966b81c None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:01:30.939945 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee9fc75-6b04-48c1-8b69-4c6f1966b81c None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:01:30.940248 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee9fc75-6b04-48c1-8b69-4c6f1966b81c None admin] PATH_INFO: `/v3/projects/service` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:01:30.949087 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee9fc75-6b04-48c1-8b69-4c6f1966b81c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:01:30.951350 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee9fc75-6b04-48c1-8b69-4c6f1966b81c None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:01:30.966253 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application [None req-6ee9fc75-6b04-48c1-8b69-4c6f1966b81c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 28 19:01:30.966253 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 19:01:30.966253 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 19:01:30.966253 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 19:01:30.966253 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 19:01:30.966253 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 19:01:30.966253 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 19:01:30.966253 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 19:01:30.966253 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 19:01:30.966253 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 19:01:30.966253 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 19:01:30.966253 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 19:01:30.966253 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 28 19:01:30.966253 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 28 19:01:30.966253 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 28 19:01:30.967101 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 28 19:01:30.967101 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 19:01:30.967101 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 19:01:30.967101 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 19:01:30.967101 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 19:01:30.967101 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 19:01:30.967101 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 19:01:30.967101 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 19:01:30.967101 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application with Lock( Oct 28 19:01:30.967101 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 19:01:30.967101 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._enter() Oct 28 19:01:30.967101 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 19:01:30.967101 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 19:01:30.967101 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 19:01:30.967101 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.creator() Oct 28 19:01:30.967101 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 19:01:30.967101 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application created_value = creator( Oct 28 19:01:30.967947 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 28 19:01:30.967947 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 28 19:01:30.967947 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 28 19:01:30.967947 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 28 19:01:30.967947 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 28 19:01:30.967947 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 28 19:01:30.967947 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 28 19:01:30.967947 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application Oct 28 19:01:30.969423 dv-cinder-862365-1-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 237/477] 10.222.0.23 () {56 vars in 1111 bytes} [Fri Oct 28 19:01:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 19:01:30.970406 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee9fc75-6b04-48c1-8b69-4c6f1966b81c None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:01:30.993297 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc28883-8130-4686-b9c1-b11d9421d489 None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:01:31.034433 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43296b64-723f-4d56-9d28-787e8f550fc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:01:31.035860 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43296b64-723f-4d56-9d28-787e8f550fc9 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:01:31.036342 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43296b64-723f-4d56-9d28-787e8f550fc9 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:01:31.036803 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43296b64-723f-4d56-9d28-787e8f550fc9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:01:31.046977 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43296b64-723f-4d56-9d28-787e8f550fc9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:01:31.049576 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43296b64-723f-4d56-9d28-787e8f550fc9 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:01:31.064317 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application [None req-43296b64-723f-4d56-9d28-787e8f550fc9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 28 19:01:31.064317 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 19:01:31.064317 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 19:01:31.064317 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 19:01:31.064317 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 19:01:31.064317 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 19:01:31.064317 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 19:01:31.064317 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 19:01:31.064317 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 19:01:31.064317 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 19:01:31.064317 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 19:01:31.064317 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 19:01:31.064317 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 28 19:01:31.064317 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 28 19:01:31.064317 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 28 19:01:31.065138 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 28 19:01:31.065138 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 19:01:31.065138 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 19:01:31.065138 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 19:01:31.065138 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 19:01:31.065138 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 19:01:31.065138 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 19:01:31.065138 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 19:01:31.065138 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application with Lock( Oct 28 19:01:31.065138 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 19:01:31.065138 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._enter() Oct 28 19:01:31.065138 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 19:01:31.065138 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 19:01:31.065138 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 19:01:31.065138 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.creator() Oct 28 19:01:31.065138 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 19:01:31.065138 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application created_value = creator( Oct 28 19:01:31.066013 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 28 19:01:31.066013 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 28 19:01:31.066013 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 28 19:01:31.066013 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 28 19:01:31.066013 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 28 19:01:31.066013 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 28 19:01:31.066013 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 28 19:01:31.066013 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Oct 28 19:01:31.067183 dv-cinder-862365-1-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 241/478] 10.222.0.23 () {56 vars in 1111 bytes} [Fri Oct 28 19:01:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 19:01:31.067680 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43296b64-723f-4d56-9d28-787e8f550fc9 None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:01:31.095287 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee9fc75-6b04-48c1-8b69-4c6f1966b81c None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:01:31.144109 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8515fc18-4a2a-4062-b197-70e697fb42ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:01:31.145129 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8515fc18-4a2a-4062-b197-70e697fb42ad None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:01:31.145459 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8515fc18-4a2a-4062-b197-70e697fb42ad None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:01:31.145742 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8515fc18-4a2a-4062-b197-70e697fb42ad None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:01:31.159147 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8515fc18-4a2a-4062-b197-70e697fb42ad None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:01:31.160621 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8515fc18-4a2a-4062-b197-70e697fb42ad None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:01:31.179076 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application [None req-8515fc18-4a2a-4062-b197-70e697fb42ad None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 19:01:31.179076 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 19:01:31.179076 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 19:01:31.179076 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 19:01:31.179076 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 19:01:31.179076 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 19:01:31.179076 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 19:01:31.179076 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 19:01:31.179076 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 19:01:31.179076 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 19:01:31.179076 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 19:01:31.179076 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 19:01:31.179076 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 28 19:01:31.179076 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 28 19:01:31.179076 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 28 19:01:31.179076 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 28 19:01:31.180097 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 19:01:31.180097 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 19:01:31.180097 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 19:01:31.180097 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 19:01:31.180097 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 19:01:31.180097 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 19:01:31.180097 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 19:01:31.180097 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application with Lock( Oct 28 19:01:31.180097 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 19:01:31.180097 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._enter() Oct 28 19:01:31.180097 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 19:01:31.180097 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 19:01:31.180097 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 19:01:31.180097 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.creator() Oct 28 19:01:31.180097 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 19:01:31.180097 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application created_value = creator( Oct 28 19:01:31.180097 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 28 19:01:31.180926 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 28 19:01:31.180926 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 19:01:31.180926 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application Oct 28 19:01:31.185505 dv-cinder-862365-1-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 238/479] 10.222.0.23 () {56 vars in 1108 bytes} [Fri Oct 28 19:01:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 19:01:31.187572 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8515fc18-4a2a-4062-b197-70e697fb42ad None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:01:31.197866 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:01:31.202700 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43296b64-723f-4d56-9d28-787e8f550fc9 None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:01:31.216737 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:01:31.245552 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351d56a6-548e-4db7-b8a4-46ff67126e47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:01:31.246496 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351d56a6-548e-4db7-b8a4-46ff67126e47 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:01:31.246938 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351d56a6-548e-4db7-b8a4-46ff67126e47 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:01:31.247371 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351d56a6-548e-4db7-b8a4-46ff67126e47 None admin] PATH_INFO: `/v3/projects` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:01:31.248246 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351d56a6-548e-4db7-b8a4-46ff67126e47 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:01:31.248724 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351d56a6-548e-4db7-b8a4-46ff67126e47 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:01:31.250350 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351d56a6-548e-4db7-b8a4-46ff67126e47 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:01:31.267642 dv-cinder-862365-1-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 242/480] 10.222.0.23 () {56 vars in 1148 bytes} [Fri Oct 28 19:01:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:01:31.268767 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351d56a6-548e-4db7-b8a4-46ff67126e47 None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:01:31.314087 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8515fc18-4a2a-4062-b197-70e697fb42ad None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:01:31.356619 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b7a059-a866-49d8-8835-83bf8d551820 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:01:31.357384 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b7a059-a866-49d8-8835-83bf8d551820 None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:01:31.357875 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b7a059-a866-49d8-8835-83bf8d551820 None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:01:31.358283 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b7a059-a866-49d8-8835-83bf8d551820 None admin] PATH_INFO: `/v3/projects` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:01:31.359121 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b7a059-a866-49d8-8835-83bf8d551820 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81765) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:01:31.359559 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b7a059-a866-49d8-8835-83bf8d551820 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:01:31.361783 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b7a059-a866-49d8-8835-83bf8d551820 None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:01:31.376824 dv-cinder-862365-1-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 239/481] 10.222.0.23 () {56 vars in 1148 bytes} [Fri Oct 28 19:01:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:01:31.377000 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351d56a6-548e-4db7-b8a4-46ff67126e47 None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:01:31.378048 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b7a059-a866-49d8-8835-83bf8d551820 None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:01:31.417075 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0aa427-b0d5-43b6-90a0-533fafb8864c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:01:31.417910 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0aa427-b0d5-43b6-90a0-533fafb8864c None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:01:31.418298 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0aa427-b0d5-43b6-90a0-533fafb8864c None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:01:31.418717 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0aa427-b0d5-43b6-90a0-533fafb8864c None admin] PATH_INFO: `/v3/domains` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:01:31.419527 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0aa427-b0d5-43b6-90a0-533fafb8864c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:01:31.419930 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0aa427-b0d5-43b6-90a0-533fafb8864c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:01:31.421693 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0aa427-b0d5-43b6-90a0-533fafb8864c None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:01:31.438673 dv-cinder-862365-1-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 243/482] 10.222.0.23 () {56 vars in 1109 bytes} [Fri Oct 28 19:01:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:01:31.439795 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0aa427-b0d5-43b6-90a0-533fafb8864c None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:01:31.462590 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:01:31.477286 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:01:31.500112 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b7a059-a866-49d8-8835-83bf8d551820 None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:01:31.543958 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b4d495-2f6b-4f0e-88d9-9f9589d082b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:01:31.545490 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b4d495-2f6b-4f0e-88d9-9f9589d082b2 None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:01:31.545982 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b4d495-2f6b-4f0e-88d9-9f9589d082b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:01:31.546421 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b4d495-2f6b-4f0e-88d9-9f9589d082b2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:01:31.546733 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0aa427-b0d5-43b6-90a0-533fafb8864c None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:01:31.547511 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b4d495-2f6b-4f0e-88d9-9f9589d082b2 None admin] RBAC: Adding query filter params (role.id=068b73485c0e46cb8a8d88b948028746, scope.project.id=b705897907f042c0818a931052438e1e, user.id=c855af0d7b0746d2b8fdf3f0b8e58cd3) {{(pid=81765) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:01:31.547987 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b4d495-2f6b-4f0e-88d9-9f9589d082b2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:01:31.550235 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b4d495-2f6b-4f0e-88d9-9f9589d082b2 None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:01:31.558725 dv-cinder-862365-1-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 240/483] 10.222.0.23 () {56 vars in 1374 bytes} [Fri Oct 28 19:01:31 2022] GET /identity/v3/role_assignments?user.id=c855af0d7b0746d2b8fdf3f0b8e58cd3&scope.project.id=b705897907f042c0818a931052438e1e&role.id=068b73485c0e46cb8a8d88b948028746 => generated 608 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:01:31.560400 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b4d495-2f6b-4f0e-88d9-9f9589d082b2 None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:01:31.622607 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519f8408-0d64-4ee8-8cb1-11d725d45814 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:01:31.630254 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519f8408-0d64-4ee8-8cb1-11d725d45814 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:01:31.630613 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519f8408-0d64-4ee8-8cb1-11d725d45814 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:01:31.630820 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519f8408-0d64-4ee8-8cb1-11d725d45814 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:01:31.631579 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519f8408-0d64-4ee8-8cb1-11d725d45814 None admin] RBAC: Adding query filter params (role.id=068b73485c0e46cb8a8d88b948028746, scope.project.id=b705897907f042c0818a931052438e1e, user.id=e441de25d614487c80452642c67df04a) {{(pid=81766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:01:31.631891 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519f8408-0d64-4ee8-8cb1-11d725d45814 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:01:31.633529 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519f8408-0d64-4ee8-8cb1-11d725d45814 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:01:31.652046 dv-cinder-862365-1-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 244/484] 10.222.0.23 () {56 vars in 1374 bytes} [Fri Oct 28 19:01:31 2022] GET /identity/v3/role_assignments?user.id=e441de25d614487c80452642c67df04a&scope.project.id=b705897907f042c0818a931052438e1e&role.id=068b73485c0e46cb8a8d88b948028746 => generated 608 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:01:31.723912 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b4d495-2f6b-4f0e-88d9-9f9589d082b2 None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:01:31.750911 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b327219c-6eee-447a-916b-0d2b9024afab None None] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:01:31.751247 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b327219c-6eee-447a-916b-0d2b9024afab None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:01:31.751469 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b327219c-6eee-447a-916b-0d2b9024afab None None] PATH_INFO: `/` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:01:31.753401 dv-cinder-862365-1-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 245/485] 10.222.0.23 () {54 vars in 927 bytes} [Fri Oct 28 19:01:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 28 19:01:31.760743 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0b6803-fddf-45ab-aba6-65ed5d8ffb41 None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:01:31.761388 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0b6803-fddf-45ab-aba6-65ed5d8ffb41 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:01:31.761868 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0b6803-fddf-45ab-aba6-65ed5d8ffb41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:01:31.765742 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f0839c-9d5e-409e-95aa-8b3a1ac1cf1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:01:31.766383 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f0839c-9d5e-409e-95aa-8b3a1ac1cf1d None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:01:31.766661 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f0839c-9d5e-409e-95aa-8b3a1ac1cf1d None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:01:31.766930 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f0839c-9d5e-409e-95aa-8b3a1ac1cf1d None admin] PATH_INFO: `/v3/projects/service` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:01:31.775069 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f0839c-9d5e-409e-95aa-8b3a1ac1cf1d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:01:31.777176 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f0839c-9d5e-409e-95aa-8b3a1ac1cf1d None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:01:31.789743 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application [None req-47f0839c-9d5e-409e-95aa-8b3a1ac1cf1d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 28 19:01:31.789743 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 19:01:31.789743 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 19:01:31.789743 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 19:01:31.789743 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 19:01:31.789743 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 19:01:31.789743 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 19:01:31.789743 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 19:01:31.789743 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 19:01:31.789743 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 19:01:31.789743 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 19:01:31.789743 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 19:01:31.789743 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 28 19:01:31.789743 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 28 19:01:31.789743 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 28 19:01:31.791530 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 28 19:01:31.791530 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 19:01:31.791530 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 19:01:31.791530 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 19:01:31.791530 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 19:01:31.791530 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 19:01:31.791530 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 19:01:31.791530 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 19:01:31.791530 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application with Lock( Oct 28 19:01:31.791530 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 19:01:31.791530 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._enter() Oct 28 19:01:31.791530 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 19:01:31.791530 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 19:01:31.791530 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 19:01:31.791530 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.creator() Oct 28 19:01:31.791530 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 19:01:31.791530 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application created_value = creator( Oct 28 19:01:31.793285 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 28 19:01:31.793285 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 28 19:01:31.793285 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 28 19:01:31.793285 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 28 19:01:31.793285 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 28 19:01:31.793285 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 28 19:01:31.793285 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 28 19:01:31.793285 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application Oct 28 19:01:31.793285 dv-cinder-862365-1-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 241/486] 10.222.0.23 () {56 vars in 1111 bytes} [Fri Oct 28 19:01:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 19:01:31.795856 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-0f0b6803-fddf-45ab-aba6-65ed5d8ffb41 None None] MFA Rules not processed for user `ae863915635746d1ac19970949de4722`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:01:31.795856 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-0f0b6803-fddf-45ab-aba6-65ed5d8ffb41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:01:31.798082 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f0839c-9d5e-409e-95aa-8b3a1ac1cf1d None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:01:31.804700 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:01:31.899255 dv-cinder-862365-1-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 246/487] 10.222.0.23 () {58 vars in 1024 bytes} [Fri Oct 28 19:01:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 28 19:01:31.901677 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786c947e-a78b-4346-b771-5b22aeab06fb None None] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:01:31.901981 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786c947e-a78b-4346-b771-5b22aeab06fb None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:01:31.902257 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786c947e-a78b-4346-b771-5b22aeab06fb None None] PATH_INFO: `/` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:01:31.908761 dv-cinder-862365-1-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 247/488] 10.222.0.23 () {54 vars in 927 bytes} [Fri Oct 28 19:01:31 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 19:01:31.913007 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482139e1-1414-429b-a3c7-4452cedd0858 None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:01:31.913295 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482139e1-1414-429b-a3c7-4452cedd0858 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:01:31.913817 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482139e1-1414-429b-a3c7-4452cedd0858 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:01:31.939110 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f0839c-9d5e-409e-95aa-8b3a1ac1cf1d None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:01:31.942209 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-482139e1-1414-429b-a3c7-4452cedd0858 None None] MFA Rules not processed for user `ae863915635746d1ac19970949de4722`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:01:31.943638 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-482139e1-1414-429b-a3c7-4452cedd0858 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:01:31.958895 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:01:31.982665 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd25b592-d2f0-4130-bff1-9e34e1d2c4e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:01:31.983262 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd25b592-d2f0-4130-bff1-9e34e1d2c4e8 None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:01:31.983545 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd25b592-d2f0-4130-bff1-9e34e1d2c4e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:01:31.983824 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd25b592-d2f0-4130-bff1-9e34e1d2c4e8 None admin] PATH_INFO: `/v3/projects` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:01:31.984510 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd25b592-d2f0-4130-bff1-9e34e1d2c4e8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81765) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:01:31.984820 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd25b592-d2f0-4130-bff1-9e34e1d2c4e8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:01:31.986419 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd25b592-d2f0-4130-bff1-9e34e1d2c4e8 None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:01:32.003153 dv-cinder-862365-1-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 242/489] 10.222.0.23 () {56 vars in 1148 bytes} [Fri Oct 28 19:01:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:01:32.011351 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd25b592-d2f0-4130-bff1-9e34e1d2c4e8 None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:01:32.045525 dv-cinder-862365-1-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 248/490] 10.222.0.23 () {58 vars in 1024 bytes} [Fri Oct 28 19:01:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 28 19:01:32.090792 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:01:32.129554 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd25b592-d2f0-4130-bff1-9e34e1d2c4e8 None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:01:32.165592 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a29534-548a-4902-adf8-21130b193c92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:01:32.166551 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a29534-548a-4902-adf8-21130b193c92 None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:01:32.167039 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a29534-548a-4902-adf8-21130b193c92 None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:01:32.167506 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a29534-548a-4902-adf8-21130b193c92 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:01:32.168409 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a29534-548a-4902-adf8-21130b193c92 None admin] RBAC: Adding query filter params (role.id=068b73485c0e46cb8a8d88b948028746, scope.project.id=b705897907f042c0818a931052438e1e, user.id=a31a9efd8dc04c9aa64c42a3779c550d) {{(pid=81765) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:01:32.168916 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a29534-548a-4902-adf8-21130b193c92 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:01:32.170578 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a29534-548a-4902-adf8-21130b193c92 None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:01:32.177138 dv-cinder-862365-1-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 243/491] 10.222.0.23 () {56 vars in 1374 bytes} [Fri Oct 28 19:01:32 2022] GET /identity/v3/role_assignments?user.id=a31a9efd8dc04c9aa64c42a3779c550d&scope.project.id=b705897907f042c0818a931052438e1e&role.id=068b73485c0e46cb8a8d88b948028746 => generated 608 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:01:32.196791 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482139e1-1414-429b-a3c7-4452cedd0858 None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:01:32.315249 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482139e1-1414-429b-a3c7-4452cedd0858 None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:01:32.351448 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a29534-548a-4902-adf8-21130b193c92 None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:01:32.358398 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2226adf6-629c-4d60-8f68-cd85485b4dfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:01:32.359475 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2226adf6-629c-4d60-8f68-cd85485b4dfc None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:01:32.359950 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2226adf6-629c-4d60-8f68-cd85485b4dfc None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:01:32.360432 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2226adf6-629c-4d60-8f68-cd85485b4dfc None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:01:32.375837 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2226adf6-629c-4d60-8f68-cd85485b4dfc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 19:01:32.383509 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application [None req-2226adf6-629c-4d60-8f68-cd85485b4dfc None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 28 19:01:32.383509 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 19:01:32.383509 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 19:01:32.383509 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 19:01:32.383509 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 19:01:32.383509 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 19:01:32.383509 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 19:01:32.383509 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 19:01:32.383509 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 19:01:32.383509 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 19:01:32.383509 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 19:01:32.383509 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 19:01:32.383509 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 28 19:01:32.383509 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 28 19:01:32.383509 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 28 19:01:32.383509 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 28 19:01:32.384454 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 28 19:01:32.384454 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 28 19:01:32.384454 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 28 19:01:32.384454 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 28 19:01:32.384454 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 19:01:32.384454 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 19:01:32.384454 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 19:01:32.384454 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 19:01:32.384454 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 19:01:32.384454 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 19:01:32.384454 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 19:01:32.384454 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application with Lock( Oct 28 19:01:32.384454 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 19:01:32.384454 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._enter() Oct 28 19:01:32.384454 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 19:01:32.384454 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 19:01:32.385825 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 19:01:32.385825 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.creator() Oct 28 19:01:32.385825 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 19:01:32.385825 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application created_value = creator( Oct 28 19:01:32.385825 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 28 19:01:32.385825 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 28 19:01:32.385825 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 28 19:01:32.385825 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 28 19:01:32.385825 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 28 19:01:32.385825 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 28 19:01:32.385825 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 28 19:01:32.385825 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Oct 28 19:01:32.387341 dv-cinder-862365-1-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 249/492] 10.222.0.23 () {56 vars in 1096 bytes} [Fri Oct 28 19:01:32 2022] GET /identity/v3/roles/admin => generated 83 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 19:01:32.393166 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2226adf6-629c-4d60-8f68-cd85485b4dfc None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:01:32.398890 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:01:32.496042 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a29534-548a-4902-adf8-21130b193c92 None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:01:32.524304 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2226adf6-629c-4d60-8f68-cd85485b4dfc None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:01:32.533651 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:01:32.546227 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad95350-bd0c-415a-bccd-6172c8060e87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:01:32.546954 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad95350-bd0c-415a-bccd-6172c8060e87 None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:01:32.547147 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad95350-bd0c-415a-bccd-6172c8060e87 None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:01:32.547424 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad95350-bd0c-415a-bccd-6172c8060e87 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:01:32.571351 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad95350-bd0c-415a-bccd-6172c8060e87 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 19:01:32.579188 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application [None req-5ad95350-bd0c-415a-bccd-6172c8060e87 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 28 19:01:32.579188 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 19:01:32.579188 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 19:01:32.579188 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 19:01:32.579188 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 19:01:32.579188 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 19:01:32.579188 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 19:01:32.579188 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 19:01:32.579188 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 19:01:32.579188 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 19:01:32.579188 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 19:01:32.579188 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 19:01:32.579188 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 28 19:01:32.579188 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 28 19:01:32.579188 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 28 19:01:32.579188 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 28 19:01:32.580296 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 28 19:01:32.580296 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 28 19:01:32.580296 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 28 19:01:32.580296 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 28 19:01:32.580296 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 19:01:32.580296 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 19:01:32.580296 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 19:01:32.580296 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 19:01:32.580296 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 19:01:32.580296 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 19:01:32.580296 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 19:01:32.580296 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application with Lock( Oct 28 19:01:32.580296 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 19:01:32.580296 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._enter() Oct 28 19:01:32.580296 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 19:01:32.580296 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 19:01:32.582195 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 19:01:32.582195 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.creator() Oct 28 19:01:32.582195 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 19:01:32.582195 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application created_value = creator( Oct 28 19:01:32.582195 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 28 19:01:32.582195 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 28 19:01:32.582195 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 28 19:01:32.582195 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 28 19:01:32.582195 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 28 19:01:32.582195 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 28 19:01:32.582195 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 28 19:01:32.582195 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application Oct 28 19:01:32.582195 dv-cinder-862365-1-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 244/493] 10.222.0.23 () {56 vars in 1102 bytes} [Fri Oct 28 19:01:32 2022] GET /identity/v3/roles/service => generated 85 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 28 19:01:32.582864 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015b3617-1b2c-4130-bf7b-6a03e6e324c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:01:32.582864 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015b3617-1b2c-4130-bf7b-6a03e6e324c2 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:01:32.582864 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015b3617-1b2c-4130-bf7b-6a03e6e324c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:01:32.582864 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015b3617-1b2c-4130-bf7b-6a03e6e324c2 None admin] PATH_INFO: `/v3/roles` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:01:32.585547 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-015b3617-1b2c-4130-bf7b-6a03e6e324c2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:01:32.585547 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-015b3617-1b2c-4130-bf7b-6a03e6e324c2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:01:32.585547 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-015b3617-1b2c-4130-bf7b-6a03e6e324c2 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:01:32.588574 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad95350-bd0c-415a-bccd-6172c8060e87 None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:01:32.605137 dv-cinder-862365-1-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 250/494] 10.222.0.23 () {56 vars in 1099 bytes} [Fri Oct 28 19:01:32 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:01:32.610325 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015b3617-1b2c-4130-bf7b-6a03e6e324c2 None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:01:32.750226 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:01:32.786234 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad95350-bd0c-415a-bccd-6172c8060e87 None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:01:32.826111 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76b066d-7579-435d-8a34-acfb3dd46feb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:01:32.826720 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76b066d-7579-435d-8a34-acfb3dd46feb None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:01:32.827003 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76b066d-7579-435d-8a34-acfb3dd46feb None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:01:32.827882 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76b066d-7579-435d-8a34-acfb3dd46feb None admin] PATH_INFO: `/v3/roles` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:01:32.828660 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76b066d-7579-435d-8a34-acfb3dd46feb None admin] RBAC: Adding query filter params (name=service) {{(pid=81765) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:01:32.828968 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76b066d-7579-435d-8a34-acfb3dd46feb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:01:32.831352 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015b3617-1b2c-4130-bf7b-6a03e6e324c2 None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:01:32.836946 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76b066d-7579-435d-8a34-acfb3dd46feb None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:01:32.856937 dv-cinder-862365-1-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 245/495] 10.222.0.23 () {56 vars in 1103 bytes} [Fri Oct 28 19:01:32 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:01:32.865305 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76b066d-7579-435d-8a34-acfb3dd46feb None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:01:32.886033 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c6ec2a-3ff7-4fec-a11b-7ea0165413fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:01:32.886033 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c6ec2a-3ff7-4fec-a11b-7ea0165413fd None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:01:32.886033 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c6ec2a-3ff7-4fec-a11b-7ea0165413fd None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:01:32.886033 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c6ec2a-3ff7-4fec-a11b-7ea0165413fd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:01:32.900427 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c6ec2a-3ff7-4fec-a11b-7ea0165413fd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:01:32.902549 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c6ec2a-3ff7-4fec-a11b-7ea0165413fd None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:01:32.918226 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application [None req-41c6ec2a-3ff7-4fec-a11b-7ea0165413fd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 19:01:32.918226 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 19:01:32.918226 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 19:01:32.918226 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 19:01:32.918226 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 19:01:32.918226 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 19:01:32.918226 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 19:01:32.918226 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 19:01:32.918226 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 19:01:32.918226 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 19:01:32.918226 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 19:01:32.918226 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 19:01:32.918226 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 28 19:01:32.918226 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 28 19:01:32.918226 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 28 19:01:32.918226 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 28 19:01:32.919289 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 19:01:32.919289 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 19:01:32.919289 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 19:01:32.919289 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 19:01:32.919289 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 19:01:32.919289 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 19:01:32.919289 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 19:01:32.919289 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application with Lock( Oct 28 19:01:32.919289 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 19:01:32.919289 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._enter() Oct 28 19:01:32.919289 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 19:01:32.919289 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 19:01:32.919289 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 19:01:32.919289 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.creator() Oct 28 19:01:32.919289 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 19:01:32.919289 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application created_value = creator( Oct 28 19:01:32.919289 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 28 19:01:32.920144 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 28 19:01:32.920144 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 19:01:32.920144 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Oct 28 19:01:32.920144 dv-cinder-862365-1-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 251/496] 10.222.0.23 () {56 vars in 1108 bytes} [Fri Oct 28 19:01:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 310 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 28 19:01:32.924758 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c6ec2a-3ff7-4fec-a11b-7ea0165413fd None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:01:32.969677 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:01:33.046912 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76b066d-7579-435d-8a34-acfb3dd46feb None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:01:33.094459 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c6ec2a-3ff7-4fec-a11b-7ea0165413fd None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:01:33.111873 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de99e4b-c250-46a9-b697-5677752d2876 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:01:33.112984 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de99e4b-c250-46a9-b697-5677752d2876 None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:01:33.113482 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:01:33.114378 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de99e4b-c250-46a9-b697-5677752d2876 None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:01:33.114860 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de99e4b-c250-46a9-b697-5677752d2876 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:01:33.137392 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3d8973-f372-4ba3-98e2-5bbb531536b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:01:33.137392 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3d8973-f372-4ba3-98e2-5bbb531536b5 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:01:33.137392 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3d8973-f372-4ba3-98e2-5bbb531536b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:01:33.137392 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3d8973-f372-4ba3-98e2-5bbb531536b5 None admin] PATH_INFO: `/v3/domains` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:01:33.137808 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3d8973-f372-4ba3-98e2-5bbb531536b5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:01:33.137808 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3d8973-f372-4ba3-98e2-5bbb531536b5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:01:33.137808 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3d8973-f372-4ba3-98e2-5bbb531536b5 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:01:33.142777 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de99e4b-c250-46a9-b697-5677752d2876 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:01:33.144474 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de99e4b-c250-46a9-b697-5677752d2876 None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:01:33.160850 dv-cinder-862365-1-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 252/497] 10.222.0.23 () {56 vars in 1109 bytes} [Fri Oct 28 19:01:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 19:01:33.160850 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3d8973-f372-4ba3-98e2-5bbb531536b5 None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:01:33.172093 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application [None req-3de99e4b-c250-46a9-b697-5677752d2876 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 19:01:33.172093 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 19:01:33.172093 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 19:01:33.172093 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 19:01:33.172093 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 19:01:33.172093 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 19:01:33.172093 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 19:01:33.172093 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 19:01:33.172093 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 19:01:33.172093 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 19:01:33.172093 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 19:01:33.172093 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 19:01:33.172093 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 28 19:01:33.172093 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 28 19:01:33.172093 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 28 19:01:33.172093 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 28 19:01:33.173009 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 19:01:33.173009 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 19:01:33.173009 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 19:01:33.173009 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 19:01:33.173009 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 19:01:33.173009 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 19:01:33.173009 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 19:01:33.173009 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application with Lock( Oct 28 19:01:33.173009 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 19:01:33.173009 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._enter() Oct 28 19:01:33.173009 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 19:01:33.173009 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 19:01:33.173009 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 19:01:33.173009 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.creator() Oct 28 19:01:33.173009 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 19:01:33.173009 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application created_value = creator( Oct 28 19:01:33.173009 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 28 19:01:33.173935 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 28 19:01:33.173935 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 19:01:33.173935 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application Oct 28 19:01:33.176088 dv-cinder-862365-1-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 246/498] 10.222.0.23 () {56 vars in 1108 bytes} [Fri Oct 28 19:01:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 312 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 19:01:33.186243 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de99e4b-c250-46a9-b697-5677752d2876 None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:01:33.318496 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de99e4b-c250-46a9-b697-5677752d2876 None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:01:33.320108 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:01:33.356301 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3d8973-f372-4ba3-98e2-5bbb531536b5 None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:01:33.382574 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1bd9c57-6d32-4437-948e-8a5dd37d655e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:01:33.383185 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bd9c57-6d32-4437-948e-8a5dd37d655e None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:01:33.383462 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bd9c57-6d32-4437-948e-8a5dd37d655e None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:01:33.383734 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bd9c57-6d32-4437-948e-8a5dd37d655e None admin] PATH_INFO: `/v3/domains` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:01:33.384367 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1bd9c57-6d32-4437-948e-8a5dd37d655e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81765) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:01:33.384667 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1bd9c57-6d32-4437-948e-8a5dd37d655e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:01:33.386603 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1bd9c57-6d32-4437-948e-8a5dd37d655e None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:01:33.409117 dv-cinder-862365-1-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 247/499] 10.222.0.23 () {56 vars in 1109 bytes} [Fri Oct 28 19:01:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:01:33.415000 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1bd9c57-6d32-4437-948e-8a5dd37d655e None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:01:33.422347 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3d6079-d70a-4e0f-9399-1da9a4236761 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:01:33.422978 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3d6079-d70a-4e0f-9399-1da9a4236761 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:01:33.423255 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3d6079-d70a-4e0f-9399-1da9a4236761 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:01:33.423525 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3d6079-d70a-4e0f-9399-1da9a4236761 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:01:33.437994 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3d6079-d70a-4e0f-9399-1da9a4236761 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:01:33.439721 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3d6079-d70a-4e0f-9399-1da9a4236761 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:01:33.452944 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application [None req-ac3d6079-d70a-4e0f-9399-1da9a4236761 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 28 19:01:33.452944 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 19:01:33.452944 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 19:01:33.452944 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 19:01:33.452944 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 19:01:33.452944 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 19:01:33.452944 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 19:01:33.452944 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 19:01:33.452944 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 19:01:33.452944 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 19:01:33.452944 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 19:01:33.452944 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 19:01:33.452944 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 28 19:01:33.452944 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 28 19:01:33.452944 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 28 19:01:33.452944 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 28 19:01:33.454062 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 19:01:33.454062 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 19:01:33.454062 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 28 19:01:33.454062 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 28 19:01:33.454062 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 28 19:01:33.454062 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 28 19:01:33.454062 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 19:01:33.454062 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 19:01:33.454062 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 19:01:33.454062 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 19:01:33.454062 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 19:01:33.454062 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application with Lock( Oct 28 19:01:33.454062 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 19:01:33.454062 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._enter() Oct 28 19:01:33.454062 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 19:01:33.454062 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 19:01:33.454062 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 19:01:33.454062 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.creator() Oct 28 19:01:33.455463 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 19:01:33.455463 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application created_value = creator( Oct 28 19:01:33.455463 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 28 19:01:33.455463 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 28 19:01:33.455463 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 28 19:01:33.455463 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 28 19:01:33.455463 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 28 19:01:33.455463 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 28 19:01:33.455463 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 28 19:01:33.455463 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Oct 28 19:01:33.455463 dv-cinder-862365-1-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 253/500] 10.222.0.23 () {56 vars in 1093 bytes} [Fri Oct 28 19:01:33 2022] GET /identity/v3/users/nova => generated 82 bytes in 296 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 19:01:33.459877 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3d6079-d70a-4e0f-9399-1da9a4236761 None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:01:33.532905 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:01:33.597462 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1bd9c57-6d32-4437-948e-8a5dd37d655e None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:01:33.647815 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3d6079-d70a-4e0f-9399-1da9a4236761 None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:01:33.659660 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb98b3c7-2700-4dc6-abba-e75cfbeb1154 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:01:33.660293 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb98b3c7-2700-4dc6-abba-e75cfbeb1154 None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:01:33.660569 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb98b3c7-2700-4dc6-abba-e75cfbeb1154 None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:01:33.660835 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb98b3c7-2700-4dc6-abba-e75cfbeb1154 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:01:33.671918 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb98b3c7-2700-4dc6-abba-e75cfbeb1154 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:01:33.673376 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb98b3c7-2700-4dc6-abba-e75cfbeb1154 None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:01:33.694924 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application [None req-eb98b3c7-2700-4dc6-abba-e75cfbeb1154 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Oct 28 19:01:33.694924 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 19:01:33.694924 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 19:01:33.694924 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 19:01:33.694924 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 19:01:33.694924 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 19:01:33.694924 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 19:01:33.694924 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 19:01:33.694924 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 19:01:33.694924 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 19:01:33.694924 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 19:01:33.694924 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 19:01:33.694924 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 28 19:01:33.694924 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 28 19:01:33.694924 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 28 19:01:33.694924 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 28 19:01:33.695893 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 19:01:33.695893 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 19:01:33.695893 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 28 19:01:33.695893 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 28 19:01:33.695893 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 28 19:01:33.695893 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 28 19:01:33.695893 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 19:01:33.695893 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 19:01:33.695893 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 19:01:33.695893 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 19:01:33.695893 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 19:01:33.695893 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application with Lock( Oct 28 19:01:33.695893 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 19:01:33.695893 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._enter() Oct 28 19:01:33.695893 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 19:01:33.695893 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 19:01:33.695893 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 19:01:33.695893 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.creator() Oct 28 19:01:33.696825 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 19:01:33.696825 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application created_value = creator( Oct 28 19:01:33.696825 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 28 19:01:33.696825 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 28 19:01:33.696825 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 28 19:01:33.696825 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 28 19:01:33.696825 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 28 19:01:33.696825 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 28 19:01:33.696825 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Oct 28 19:01:33.696825 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application Oct 28 19:01:33.699969 dv-cinder-862365-1-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 248/501] 10.222.0.23 () {56 vars in 1096 bytes} [Fri Oct 28 19:01:33 2022] GET /identity/v3/users/swift => generated 83 bytes in 285 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 19:01:33.706165 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb98b3c7-2700-4dc6-abba-e75cfbeb1154 None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:01:33.711587 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05daeda0-a52a-45e4-b396-3bdcbe661c2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:01:33.712240 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05daeda0-a52a-45e4-b396-3bdcbe661c2a None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:01:33.712520 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05daeda0-a52a-45e4-b396-3bdcbe661c2a None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:01:33.712790 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05daeda0-a52a-45e4-b396-3bdcbe661c2a None admin] PATH_INFO: `/v3/users` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:01:33.713575 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05daeda0-a52a-45e4-b396-3bdcbe661c2a None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:01:33.713881 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05daeda0-a52a-45e4-b396-3bdcbe661c2a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:01:33.715298 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05daeda0-a52a-45e4-b396-3bdcbe661c2a None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:01:33.757056 dv-cinder-862365-1-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 254/502] 10.222.0.23 () {56 vars in 1133 bytes} [Fri Oct 28 19:01:33 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:01:33.757708 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:01:33.761914 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05daeda0-a52a-45e4-b396-3bdcbe661c2a None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:01:33.914339 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:01:33.923176 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05daeda0-a52a-45e4-b396-3bdcbe661c2a None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:01:33.940236 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb98b3c7-2700-4dc6-abba-e75cfbeb1154 None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:01:33.988128 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ee69aa-f1a2-435b-9c05-ea8a78e45d1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:01:33.988744 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ee69aa-f1a2-435b-9c05-ea8a78e45d1e None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:01:33.989022 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ee69aa-f1a2-435b-9c05-ea8a78e45d1e None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:01:33.989296 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ee69aa-f1a2-435b-9c05-ea8a78e45d1e None admin] PATH_INFO: `/v3/users` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:01:33.990050 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ee69aa-f1a2-435b-9c05-ea8a78e45d1e None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81765) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:01:33.990243 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3c9c05-b625-4470-9565-72a846457ee8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:01:33.990364 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ee69aa-f1a2-435b-9c05-ea8a78e45d1e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:01:33.991143 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3c9c05-b625-4470-9565-72a846457ee8 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:01:33.991561 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3c9c05-b625-4470-9565-72a846457ee8 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:01:33.991753 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ee69aa-f1a2-435b-9c05-ea8a78e45d1e None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:01:33.992120 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3c9c05-b625-4470-9565-72a846457ee8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:01:34.003256 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3c9c05-b625-4470-9565-72a846457ee8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:01:34.004898 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3c9c05-b625-4470-9565-72a846457ee8 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:01:34.020560 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application [None req-8c3c9c05-b625-4470-9565-72a846457ee8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 19:01:34.020560 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 19:01:34.020560 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 19:01:34.020560 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 19:01:34.020560 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 19:01:34.020560 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 19:01:34.020560 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 19:01:34.020560 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 19:01:34.020560 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 19:01:34.020560 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 19:01:34.020560 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 19:01:34.020560 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 19:01:34.020560 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 28 19:01:34.020560 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 28 19:01:34.020560 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 28 19:01:34.020560 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 28 19:01:34.021744 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 19:01:34.021744 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 19:01:34.021744 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 19:01:34.021744 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 19:01:34.021744 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 19:01:34.021744 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 19:01:34.021744 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 19:01:34.021744 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application with Lock( Oct 28 19:01:34.021744 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 19:01:34.021744 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._enter() Oct 28 19:01:34.021744 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 19:01:34.021744 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 19:01:34.021744 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 19:01:34.021744 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.creator() Oct 28 19:01:34.021744 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 19:01:34.021744 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application created_value = creator( Oct 28 19:01:34.021744 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 28 19:01:34.022859 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 28 19:01:34.022859 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 19:01:34.022859 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Oct 28 19:01:34.029244 dv-cinder-862365-1-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 255/503] 10.222.0.23 () {56 vars in 1108 bytes} [Fri Oct 28 19:01:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 19:01:34.030623 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3c9c05-b625-4470-9565-72a846457ee8 None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:01:34.033153 dv-cinder-862365-1-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 249/504] 10.222.0.23 () {56 vars in 1135 bytes} [Fri Oct 28 19:01:33 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 327 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:01:34.039639 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ee69aa-f1a2-435b-9c05-ea8a78e45d1e None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:01:34.154944 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3c9c05-b625-4470-9565-72a846457ee8 None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:01:34.162663 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ee69aa-f1a2-435b-9c05-ea8a78e45d1e None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:01:34.165832 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:01:34.198375 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7854c0-1a80-4eb5-a832-a0866a6bc00d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:01:34.199318 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e111512c-c187-4b77-a8dd-0d93a0ae4c13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:01:34.199681 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7854c0-1a80-4eb5-a832-a0866a6bc00d None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:01:34.199985 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e111512c-c187-4b77-a8dd-0d93a0ae4c13 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:01:34.200266 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e111512c-c187-4b77-a8dd-0d93a0ae4c13 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:01:34.200538 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e111512c-c187-4b77-a8dd-0d93a0ae4c13 None admin] PATH_INFO: `/v3/domains` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:01:34.200840 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7854c0-1a80-4eb5-a832-a0866a6bc00d None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:01:34.201180 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e111512c-c187-4b77-a8dd-0d93a0ae4c13 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:01:34.201515 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e111512c-c187-4b77-a8dd-0d93a0ae4c13 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:01:34.201834 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7854c0-1a80-4eb5-a832-a0866a6bc00d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:01:34.202937 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e111512c-c187-4b77-a8dd-0d93a0ae4c13 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:01:34.225374 dv-cinder-862365-1-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 256/505] 10.222.0.23 () {56 vars in 1109 bytes} [Fri Oct 28 19:01:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:01:34.225374 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb5aaac-0ce9-4ac1-a60c-13babf8839f0 None None] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:01:34.225374 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb5aaac-0ce9-4ac1-a60c-13babf8839f0 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:01:34.225374 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb5aaac-0ce9-4ac1-a60c-13babf8839f0 None None] PATH_INFO: `/` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:01:34.225374 dv-cinder-862365-1-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 257/506] 10.222.0.23 () {54 vars in 927 bytes} [Fri Oct 28 19:01:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 19:01:34.231895 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb5aaac-0ce9-4ac1-a60c-13babf8839f0 None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:01:34.239675 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:01:34.291068 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7854c0-1a80-4eb5-a832-a0866a6bc00d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:01:34.293048 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7854c0-1a80-4eb5-a832-a0866a6bc00d None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:01:34.367872 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb5aaac-0ce9-4ac1-a60c-13babf8839f0 None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:01:34.384858 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:01:34.406859 dv-cinder-862365-1-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 250/507] 10.222.0.23 () {58 vars in 1282 bytes} [Fri Oct 28 19:01:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Oct 28 19:01:34.408619 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80d08f3-3fd7-408c-b8d1-a2b4d7dc3bc7 None None] REQUEST_METHOD: `POST` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:01:34.409211 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80d08f3-3fd7-408c-b8d1-a2b4d7dc3bc7 None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:01:34.409854 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80d08f3-3fd7-408c-b8d1-a2b4d7dc3bc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:01:34.411619 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c946f8f4-57f3-4ada-b5dc-c4135f988e69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:01:34.412306 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c946f8f4-57f3-4ada-b5dc-c4135f988e69 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:01:34.412586 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c946f8f4-57f3-4ada-b5dc-c4135f988e69 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:01:34.412856 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c946f8f4-57f3-4ada-b5dc-c4135f988e69 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:01:34.422432 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c946f8f4-57f3-4ada-b5dc-c4135f988e69 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:01:34.423825 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c946f8f4-57f3-4ada-b5dc-c4135f988e69 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:01:34.435000 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.auth.core [None req-f80d08f3-3fd7-408c-b8d1-a2b4d7dc3bc7 None None] MFA Rules not processed for user `ae863915635746d1ac19970949de4722`. Rule list: `[]` (Enabled: `True`). {{(pid=81765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:01:34.436623 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-f80d08f3-3fd7-408c-b8d1-a2b4d7dc3bc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:01:34.438840 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application [None req-c946f8f4-57f3-4ada-b5dc-c4135f988e69 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 28 19:01:34.438840 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 19:01:34.438840 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 19:01:34.438840 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 19:01:34.438840 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 19:01:34.438840 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 19:01:34.438840 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 19:01:34.438840 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 19:01:34.438840 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 19:01:34.438840 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 19:01:34.438840 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 19:01:34.438840 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 19:01:34.438840 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 28 19:01:34.438840 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 28 19:01:34.438840 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 28 19:01:34.439813 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 28 19:01:34.439813 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 19:01:34.439813 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 19:01:34.439813 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 19:01:34.439813 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 19:01:34.439813 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 19:01:34.439813 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 19:01:34.439813 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 19:01:34.439813 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application with Lock( Oct 28 19:01:34.439813 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 19:01:34.439813 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._enter() Oct 28 19:01:34.439813 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 19:01:34.439813 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 19:01:34.439813 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 19:01:34.439813 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.creator() Oct 28 19:01:34.439813 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 19:01:34.439813 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application created_value = creator( Oct 28 19:01:34.440704 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 28 19:01:34.440704 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 28 19:01:34.440704 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 28 19:01:34.440704 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 28 19:01:34.440704 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 28 19:01:34.440704 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 28 19:01:34.440704 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 28 19:01:34.440704 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Oct 28 19:01:34.440704 dv-cinder-862365-1-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 258/508] 10.222.0.23 () {56 vars in 1111 bytes} [Fri Oct 28 19:01:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 28 19:01:34.441220 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c946f8f4-57f3-4ada-b5dc-c4135f988e69 None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:01:34.529136 dv-cinder-862365-1-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 251/509] 10.222.0.23 () {58 vars in 1024 bytes} [Fri Oct 28 19:01:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 28 19:01:34.530142 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:01:34.531823 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80d08f3-3fd7-408c-b8d1-a2b4d7dc3bc7 None None] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:01:34.567745 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c946f8f4-57f3-4ada-b5dc-c4135f988e69 None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:01:34.613375 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6b8e53-debb-44a8-8433-fe8cc25947cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:01:34.614000 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6b8e53-debb-44a8-8433-fe8cc25947cf None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:01:34.614278 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6b8e53-debb-44a8-8433-fe8cc25947cf None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:01:34.614551 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6b8e53-debb-44a8-8433-fe8cc25947cf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:01:34.628651 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6b8e53-debb-44a8-8433-fe8cc25947cf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:01:34.630837 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6b8e53-debb-44a8-8433-fe8cc25947cf None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:01:34.650321 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application [None req-eb6b8e53-debb-44a8-8433-fe8cc25947cf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 19:01:34.650321 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 19:01:34.650321 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 19:01:34.650321 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 19:01:34.650321 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 19:01:34.650321 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 19:01:34.650321 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 19:01:34.650321 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 19:01:34.650321 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 19:01:34.650321 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 19:01:34.650321 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 19:01:34.650321 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 19:01:34.650321 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 28 19:01:34.650321 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 28 19:01:34.650321 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 28 19:01:34.650321 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 28 19:01:34.651347 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 19:01:34.651347 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 19:01:34.651347 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 19:01:34.651347 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 19:01:34.651347 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 19:01:34.651347 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 19:01:34.651347 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 19:01:34.651347 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application with Lock( Oct 28 19:01:34.651347 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 19:01:34.651347 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._enter() Oct 28 19:01:34.651347 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 19:01:34.651347 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 19:01:34.651347 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 19:01:34.651347 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.creator() Oct 28 19:01:34.651347 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 19:01:34.651347 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application created_value = creator( Oct 28 19:01:34.651347 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 28 19:01:34.652229 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 28 19:01:34.652229 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 19:01:34.652229 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Oct 28 19:01:34.652398 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80d08f3-3fd7-408c-b8d1-a2b4d7dc3bc7 None None] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:01:34.652799 dv-cinder-862365-1-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 259/510] 10.222.0.23 () {56 vars in 1108 bytes} [Fri Oct 28 19:01:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 19:01:34.654969 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498b3dc1-8584-4774-9e82-8d98061d8862 None None] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:01:34.654969 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498b3dc1-8584-4774-9e82-8d98061d8862 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:01:34.654969 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498b3dc1-8584-4774-9e82-8d98061d8862 None None] PATH_INFO: `/` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:01:34.660141 dv-cinder-862365-1-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 260/511] 10.222.0.23 () {54 vars in 927 bytes} [Fri Oct 28 19:01:34 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 19:01:34.661530 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498b3dc1-8584-4774-9e82-8d98061d8862 None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:01:34.665025 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:01:34.690627 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9a39ef-c2f4-43d9-a4e3-4d4493dd65c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:01:34.691075 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9a39ef-c2f4-43d9-a4e3-4d4493dd65c3 None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:01:34.691361 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9a39ef-c2f4-43d9-a4e3-4d4493dd65c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:01:34.691636 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9a39ef-c2f4-43d9-a4e3-4d4493dd65c3 None admin] PATH_INFO: `/v3/projects` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:01:34.692383 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e9a39ef-c2f4-43d9-a4e3-4d4493dd65c3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81765) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:01:34.692741 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e9a39ef-c2f4-43d9-a4e3-4d4493dd65c3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:01:34.694254 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e9a39ef-c2f4-43d9-a4e3-4d4493dd65c3 None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:01:34.707949 dv-cinder-862365-1-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 252/512] 10.222.0.23 () {56 vars in 1148 bytes} [Fri Oct 28 19:01:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:01:34.708714 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6a6476-2173-4896-8b6e-9493c02c7b23 None None] REQUEST_METHOD: `POST` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:01:34.709008 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6a6476-2173-4896-8b6e-9493c02c7b23 None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:01:34.709284 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6a6476-2173-4896-8b6e-9493c02c7b23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:01:34.729769 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.auth.core [None req-ee6a6476-2173-4896-8b6e-9493c02c7b23 None None] MFA Rules not processed for user `ae863915635746d1ac19970949de4722`. Rule list: `[]` (Enabled: `True`). {{(pid=81765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:01:34.731069 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-ee6a6476-2173-4896-8b6e-9493c02c7b23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:01:34.800450 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498b3dc1-8584-4774-9e82-8d98061d8862 None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:01:34.806069 dv-cinder-862365-1-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 253/513] 10.222.0.23 () {58 vars in 1024 bytes} [Fri Oct 28 19:01:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 28 19:01:34.813403 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6a6476-2173-4896-8b6e-9493c02c7b23 None None] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:01:34.843862 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:01:34.859748 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e301b146-fe24-4d8f-acbb-7fffeda15d64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:01:34.860361 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e301b146-fe24-4d8f-acbb-7fffeda15d64 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:01:34.860644 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e301b146-fe24-4d8f-acbb-7fffeda15d64 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:01:34.860917 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e301b146-fe24-4d8f-acbb-7fffeda15d64 None admin] PATH_INFO: `/v3/domains` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:01:34.861590 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e301b146-fe24-4d8f-acbb-7fffeda15d64 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:01:34.861896 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e301b146-fe24-4d8f-acbb-7fffeda15d64 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:01:34.863308 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e301b146-fe24-4d8f-acbb-7fffeda15d64 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:01:34.880019 dv-cinder-862365-1-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 261/514] 10.222.0.23 () {56 vars in 1109 bytes} [Fri Oct 28 19:01:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:01:34.880019 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e301b146-fe24-4d8f-acbb-7fffeda15d64 None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:01:34.939255 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:01:34.942359 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6a6476-2173-4896-8b6e-9493c02c7b23 None None] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:01:34.978010 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18fe611e-40f3-4dbc-bbaa-8e12dd7f350e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:01:34.979410 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fe611e-40f3-4dbc-bbaa-8e12dd7f350e None admin] REQUEST_METHOD: `PUT` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:01:34.979892 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fe611e-40f3-4dbc-bbaa-8e12dd7f350e None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:01:34.980318 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fe611e-40f3-4dbc-bbaa-8e12dd7f350e None admin] PATH_INFO: `/v3/projects/b705897907f042c0818a931052438e1e/users/8877180cd9844dad8b0980de34769ec8/roles/a9e4e47c2bf448fcbada91c1174644f7` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:01:34.982931 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18fe611e-40f3-4dbc-bbaa-8e12dd7f350e None admin] RBAC: Authorizing `identity:create_grant(project_id=b705897907f042c0818a931052438e1e, user_id=8877180cd9844dad8b0980de34769ec8, role_id=a9e4e47c2bf448fcbada91c1174644f7)` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:01:34.984266 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e301b146-fe24-4d8f-acbb-7fffeda15d64 None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:01:34.984767 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18fe611e-40f3-4dbc-bbaa-8e12dd7f350e None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:01:35.018444 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef54523-d849-4e1c-80d7-ebf611f6c1e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:01:35.019071 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef54523-d849-4e1c-80d7-ebf611f6c1e6 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:01:35.019351 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef54523-d849-4e1c-80d7-ebf611f6c1e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:01:35.019625 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef54523-d849-4e1c-80d7-ebf611f6c1e6 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:01:35.020198 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef54523-d849-4e1c-80d7-ebf611f6c1e6 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:01:35.021593 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef54523-d849-4e1c-80d7-ebf611f6c1e6 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:01:35.032551 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application [None req-8ef54523-d849-4e1c-80d7-ebf611f6c1e6 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 28 19:01:35.032551 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 19:01:35.032551 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 28 19:01:35.032551 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 28 19:01:35.032551 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 28 19:01:35.032551 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 28 19:01:35.032551 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 28 19:01:35.032551 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 28 19:01:35.032551 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 28 19:01:35.032551 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Oct 28 19:01:35.032551 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 28 19:01:35.032551 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Oct 28 19:01:35.032551 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 19:01:35.032551 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 19:01:35.032551 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 19:01:35.032551 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 19:01:35.032551 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 19:01:35.033590 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 19:01:35.033590 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 19:01:35.033590 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 19:01:35.033590 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 19:01:35.033590 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 19:01:35.033590 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 19:01:35.033590 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 28 19:01:35.033590 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 28 19:01:35.033590 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 28 19:01:35.033590 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 28 19:01:35.033590 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 19:01:35.033590 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 19:01:35.033590 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 19:01:35.033590 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 19:01:35.033590 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 19:01:35.033590 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 19:01:35.034524 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 19:01:35.034524 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application with Lock( Oct 28 19:01:35.034524 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 19:01:35.034524 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._enter() Oct 28 19:01:35.034524 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 19:01:35.034524 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 19:01:35.034524 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 19:01:35.034524 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.creator() Oct 28 19:01:35.034524 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 19:01:35.034524 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application created_value = creator( Oct 28 19:01:35.034524 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 28 19:01:35.034524 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 28 19:01:35.034524 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 28 19:01:35.034524 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Oct 28 19:01:35.034524 dv-cinder-862365-1-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 262/515] 10.222.0.23 () {56 vars in 1129 bytes} [Fri Oct 28 19:01:34 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 19:01:35.035925 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69834939-3edf-4258-9b90-6f1ddb541e6f None None] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:01:35.035925 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69834939-3edf-4258-9b90-6f1ddb541e6f None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:01:35.035925 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69834939-3edf-4258-9b90-6f1ddb541e6f None None] PATH_INFO: `/` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:01:35.038392 dv-cinder-862365-1-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 263/516] 10.222.0.23 () {54 vars in 927 bytes} [Fri Oct 28 19:01:35 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 19:01:35.038392 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69834939-3edf-4258-9b90-6f1ddb541e6f None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:01:35.053949 dv-cinder-862365-1-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 254/517] 10.222.0.23 () {58 vars in 1439 bytes} [Fri Oct 28 19:01:34 2022] PUT /identity/v3/projects/b705897907f042c0818a931052438e1e/users/8877180cd9844dad8b0980de34769ec8/roles/a9e4e47c2bf448fcbada91c1174644f7 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 19:01:35.066550 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18fe611e-40f3-4dbc-bbaa-8e12dd7f350e None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:01:35.094361 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:01:35.164557 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69834939-3edf-4258-9b90-6f1ddb541e6f None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:01:35.190174 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18fe611e-40f3-4dbc-bbaa-8e12dd7f350e None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:01:35.202993 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e582d9b-0188-4bf7-9191-613c5d7b874f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:01:35.203564 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e582d9b-0188-4bf7-9191-613c5d7b874f None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:01:35.203848 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e582d9b-0188-4bf7-9191-613c5d7b874f None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:01:35.204118 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e582d9b-0188-4bf7-9191-613c5d7b874f None admin] PATH_INFO: `/v3/projects/service` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:01:35.211826 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e582d9b-0188-4bf7-9191-613c5d7b874f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:01:35.213875 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e582d9b-0188-4bf7-9191-613c5d7b874f None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:01:35.226005 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application [None req-8e582d9b-0188-4bf7-9191-613c5d7b874f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 28 19:01:35.226005 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 19:01:35.226005 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 19:01:35.226005 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 19:01:35.226005 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 19:01:35.226005 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 19:01:35.226005 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 19:01:35.226005 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 19:01:35.226005 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 19:01:35.226005 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 19:01:35.226005 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 19:01:35.226005 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 19:01:35.226005 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 28 19:01:35.226005 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 28 19:01:35.226005 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 28 19:01:35.227138 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 28 19:01:35.227138 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 19:01:35.227138 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 19:01:35.227138 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 19:01:35.227138 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 19:01:35.227138 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 19:01:35.227138 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 19:01:35.227138 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 19:01:35.227138 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application with Lock( Oct 28 19:01:35.227138 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 19:01:35.227138 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._enter() Oct 28 19:01:35.227138 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 19:01:35.227138 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 19:01:35.227138 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 19:01:35.227138 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.creator() Oct 28 19:01:35.227138 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 19:01:35.227138 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application created_value = creator( Oct 28 19:01:35.228023 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 28 19:01:35.228023 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 28 19:01:35.228023 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 28 19:01:35.228023 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 28 19:01:35.228023 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 28 19:01:35.228023 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 28 19:01:35.228023 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 28 19:01:35.228023 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Oct 28 19:01:35.228023 dv-cinder-862365-1-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 264/518] 10.222.0.23 () {56 vars in 1111 bytes} [Fri Oct 28 19:01:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 19:01:35.228627 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a419dd-96bb-45ad-81de-869db7b88fbd None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:01:35.229524 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a419dd-96bb-45ad-81de-869db7b88fbd None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:01:35.229800 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a419dd-96bb-45ad-81de-869db7b88fbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:01:35.238587 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0fc3d9-fafe-4198-9192-364ac49979c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:01:35.239294 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0fc3d9-fafe-4198-9192-364ac49979c5 None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:01:35.239957 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0fc3d9-fafe-4198-9192-364ac49979c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:01:35.239957 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0fc3d9-fafe-4198-9192-364ac49979c5 None admin] PATH_INFO: `/v3/services` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:01:35.240548 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0fc3d9-fafe-4198-9192-364ac49979c5 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81765) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:01:35.240853 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0fc3d9-fafe-4198-9192-364ac49979c5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:01:35.242298 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0fc3d9-fafe-4198-9192-364ac49979c5 None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:01:35.248495 dv-cinder-862365-1-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 255/519] 10.222.0.23 () {56 vars in 1124 bytes} [Fri Oct 28 19:01:35 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:01:35.248939 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-99a419dd-96bb-45ad-81de-869db7b88fbd None None] MFA Rules not processed for user `ae863915635746d1ac19970949de4722`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:01:35.249113 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0fc3d9-fafe-4198-9192-364ac49979c5 None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:01:35.250255 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-99a419dd-96bb-45ad-81de-869db7b88fbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:01:35.276694 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:01:35.320360 dv-cinder-862365-1-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 265/520] 10.222.0.23 () {58 vars in 1024 bytes} [Fri Oct 28 19:01:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 28 19:01:35.321212 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a419dd-96bb-45ad-81de-869db7b88fbd None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:01:35.364194 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0fc3d9-fafe-4198-9192-364ac49979c5 None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:01:35.370449 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:01:35.405435 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aead8e7-0961-4325-828f-14424b5f990d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:01:35.406317 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aead8e7-0961-4325-828f-14424b5f990d None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:01:35.406769 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aead8e7-0961-4325-828f-14424b5f990d None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:01:35.407194 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aead8e7-0961-4325-828f-14424b5f990d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:01:35.418610 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aead8e7-0961-4325-828f-14424b5f990d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:01:35.420301 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aead8e7-0961-4325-828f-14424b5f990d None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:01:35.437034 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application [None req-6aead8e7-0961-4325-828f-14424b5f990d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 19:01:35.437034 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 19:01:35.437034 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 19:01:35.437034 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 19:01:35.437034 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 19:01:35.437034 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 19:01:35.437034 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 19:01:35.437034 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 19:01:35.437034 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 19:01:35.437034 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 19:01:35.437034 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 19:01:35.437034 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 19:01:35.437034 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 28 19:01:35.437034 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 28 19:01:35.437034 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 28 19:01:35.437034 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 28 19:01:35.438251 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 19:01:35.438251 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 19:01:35.438251 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 19:01:35.438251 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 19:01:35.438251 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 19:01:35.438251 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 19:01:35.438251 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 19:01:35.438251 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application with Lock( Oct 28 19:01:35.438251 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 19:01:35.438251 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._enter() Oct 28 19:01:35.438251 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 19:01:35.438251 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 19:01:35.438251 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 19:01:35.438251 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.creator() Oct 28 19:01:35.438251 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 19:01:35.438251 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application created_value = creator( Oct 28 19:01:35.438251 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 28 19:01:35.439350 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 28 19:01:35.439350 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 19:01:35.439350 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application Oct 28 19:01:35.440913 dv-cinder-862365-1-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 256/521] 10.222.0.23 () {56 vars in 1108 bytes} [Fri Oct 28 19:01:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 19:01:35.441893 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aead8e7-0961-4325-828f-14424b5f990d None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:01:35.457174 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a419dd-96bb-45ad-81de-869db7b88fbd None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:01:35.503151 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972d0e33-256c-4f3b-92cc-ad5729b6cfe3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:01:35.503947 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972d0e33-256c-4f3b-92cc-ad5729b6cfe3 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:01:35.504591 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972d0e33-256c-4f3b-92cc-ad5729b6cfe3 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:01:35.505333 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972d0e33-256c-4f3b-92cc-ad5729b6cfe3 None admin] PATH_INFO: `/v3/projects` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:01:35.506220 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972d0e33-256c-4f3b-92cc-ad5729b6cfe3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:01:35.506633 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972d0e33-256c-4f3b-92cc-ad5729b6cfe3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:01:35.508716 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972d0e33-256c-4f3b-92cc-ad5729b6cfe3 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:01:35.528448 dv-cinder-862365-1-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 266/522] 10.222.0.23 () {56 vars in 1148 bytes} [Fri Oct 28 19:01:35 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:01:35.529281 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972d0e33-256c-4f3b-92cc-ad5729b6cfe3 None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:01:35.546269 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:01:35.576981 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aead8e7-0961-4325-828f-14424b5f990d None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:01:35.616749 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5f327d-c224-49b2-8288-89b0667d7a7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:01:35.617592 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5f327d-c224-49b2-8288-89b0667d7a7a None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:01:35.617967 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5f327d-c224-49b2-8288-89b0667d7a7a None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:01:35.618333 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5f327d-c224-49b2-8288-89b0667d7a7a None admin] PATH_INFO: `/v3/services` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:01:35.619054 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5f327d-c224-49b2-8288-89b0667d7a7a None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81765) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:01:35.619501 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5f327d-c224-49b2-8288-89b0667d7a7a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:01:35.620943 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5f327d-c224-49b2-8288-89b0667d7a7a None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:01:35.627058 dv-cinder-862365-1-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 257/523] 10.222.0.23 () {56 vars in 1124 bytes} [Fri Oct 28 19:01:35 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:01:35.628038 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5f327d-c224-49b2-8288-89b0667d7a7a None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:01:35.641787 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:01:35.647846 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972d0e33-256c-4f3b-92cc-ad5729b6cfe3 None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:01:35.700002 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6116cb5e-cc10-4e6c-9a1b-a6df4b6b37f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:01:35.701770 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6116cb5e-cc10-4e6c-9a1b-a6df4b6b37f3 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:01:35.702217 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6116cb5e-cc10-4e6c-9a1b-a6df4b6b37f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:01:35.702941 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6116cb5e-cc10-4e6c-9a1b-a6df4b6b37f3 None admin] PATH_INFO: `/v3/domains` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:01:35.703756 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6116cb5e-cc10-4e6c-9a1b-a6df4b6b37f3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:01:35.704208 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6116cb5e-cc10-4e6c-9a1b-a6df4b6b37f3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:01:35.706133 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6116cb5e-cc10-4e6c-9a1b-a6df4b6b37f3 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:01:35.729955 dv-cinder-862365-1-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 267/524] 10.222.0.23 () {56 vars in 1109 bytes} [Fri Oct 28 19:01:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:01:35.729955 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6116cb5e-cc10-4e6c-9a1b-a6df4b6b37f3 None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:01:35.755111 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5f327d-c224-49b2-8288-89b0667d7a7a None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:01:35.794107 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53eed35-f5bb-4659-b9b3-78c35566abd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:01:35.794885 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53eed35-f5bb-4659-b9b3-78c35566abd0 None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:01:35.795076 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53eed35-f5bb-4659-b9b3-78c35566abd0 None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:01:35.796033 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53eed35-f5bb-4659-b9b3-78c35566abd0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:01:35.796146 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53eed35-f5bb-4659-b9b3-78c35566abd0 None admin] RBAC: Adding query filter params (role.id=068b73485c0e46cb8a8d88b948028746, scope.project.id=b705897907f042c0818a931052438e1e, user.id=ddd2863f2113472cb20577990b5c55d7) {{(pid=81765) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:01:35.796575 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53eed35-f5bb-4659-b9b3-78c35566abd0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:01:35.798136 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53eed35-f5bb-4659-b9b3-78c35566abd0 None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:01:35.806421 dv-cinder-862365-1-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 258/525] 10.222.0.23 () {56 vars in 1374 bytes} [Fri Oct 28 19:01:35 2022] GET /identity/v3/role_assignments?user.id=ddd2863f2113472cb20577990b5c55d7&scope.project.id=b705897907f042c0818a931052438e1e&role.id=068b73485c0e46cb8a8d88b948028746 => generated 608 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:01:35.807834 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53eed35-f5bb-4659-b9b3-78c35566abd0 None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:01:35.812669 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:01:35.901173 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6116cb5e-cc10-4e6c-9a1b-a6df4b6b37f3 None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:01:35.952865 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53eed35-f5bb-4659-b9b3-78c35566abd0 None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:01:35.981307 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ca64f5-7c5d-408a-a4dc-1e5494090332 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:01:35.981960 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ca64f5-7c5d-408a-a4dc-1e5494090332 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:01:35.982245 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ca64f5-7c5d-408a-a4dc-1e5494090332 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:01:35.982520 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ca64f5-7c5d-408a-a4dc-1e5494090332 None admin] PATH_INFO: `/v3/services/network` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:01:35.983122 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ca64f5-7c5d-408a-a4dc-1e5494090332 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:01:35.984554 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ca64f5-7c5d-408a-a4dc-1e5494090332 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:01:35.997384 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d682af0-d8d5-49da-a8a1-9d2ca8d20efb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:01:35.998015 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d682af0-d8d5-49da-a8a1-9d2ca8d20efb None admin] REQUEST_METHOD: `POST` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:01:35.998294 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d682af0-d8d5-49da-a8a1-9d2ca8d20efb None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:01:35.998563 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d682af0-d8d5-49da-a8a1-9d2ca8d20efb None admin] PATH_INFO: `/v3/users` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:01:35.999207 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d682af0-d8d5-49da-a8a1-9d2ca8d20efb None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:01:36.000661 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d682af0-d8d5-49da-a8a1-9d2ca8d20efb None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:01:36.001826 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application [None req-76ca64f5-7c5d-408a-a4dc-1e5494090332 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Oct 28 19:01:36.001826 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 19:01:36.001826 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 28 19:01:36.001826 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 28 19:01:36.001826 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 28 19:01:36.001826 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 28 19:01:36.001826 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 28 19:01:36.001826 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 28 19:01:36.001826 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Oct 28 19:01:36.001826 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Oct 28 19:01:36.001826 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 28 19:01:36.001826 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Oct 28 19:01:36.001826 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 19:01:36.001826 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 19:01:36.001826 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 19:01:36.001826 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 19:01:36.001826 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 19:01:36.004674 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 19:01:36.004674 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 19:01:36.004674 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 19:01:36.004674 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 19:01:36.004674 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 19:01:36.004674 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 19:01:36.004674 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 28 19:01:36.004674 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 28 19:01:36.004674 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 28 19:01:36.004674 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 28 19:01:36.004674 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 19:01:36.004674 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 19:01:36.004674 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 19:01:36.004674 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 19:01:36.004674 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 19:01:36.004674 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 19:01:36.006724 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 19:01:36.006724 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application with Lock( Oct 28 19:01:36.006724 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 19:01:36.006724 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._enter() Oct 28 19:01:36.006724 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 19:01:36.006724 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 19:01:36.006724 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 19:01:36.006724 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.creator() Oct 28 19:01:36.006724 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 19:01:36.006724 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application created_value = creator( Oct 28 19:01:36.006724 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 28 19:01:36.006724 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 28 19:01:36.006724 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Oct 28 19:01:36.006724 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Oct 28 19:01:36.006724 dv-cinder-862365-1-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 268/526] 10.222.0.23 () {56 vars in 1111 bytes} [Fri Oct 28 19:01:35 2022] GET /identity/v3/services/network => generated 88 bytes in 277 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 19:01:36.011341 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ca64f5-7c5d-408a-a4dc-1e5494090332 None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:01:36.039460 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:01:36.090123 dv-cinder-862365-1-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 259/527] 10.222.0.23 () {60 vars in 1132 bytes} [Fri Oct 28 19:01:35 2022] POST /identity/v3/users => generated 254 bytes in 283 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 19:01:36.151902 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ca64f5-7c5d-408a-a4dc-1e5494090332 None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:01:36.196379 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb5ce3e-e96f-4e25-979f-dafba8b1c705 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:01:36.197007 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb5ce3e-e96f-4e25-979f-dafba8b1c705 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:01:36.197285 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb5ce3e-e96f-4e25-979f-dafba8b1c705 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:01:36.197630 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb5ce3e-e96f-4e25-979f-dafba8b1c705 None admin] PATH_INFO: `/v3/services` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:01:36.198279 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb5ce3e-e96f-4e25-979f-dafba8b1c705 None admin] RBAC: Adding query filter params (name=network) {{(pid=81766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:01:36.198580 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb5ce3e-e96f-4e25-979f-dafba8b1c705 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:01:36.200017 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb5ce3e-e96f-4e25-979f-dafba8b1c705 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:01:36.205824 dv-cinder-862365-1-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 269/528] 10.222.0.23 () {56 vars in 1112 bytes} [Fri Oct 28 19:01:36 2022] GET /identity/v3/services?name=network => generated 124 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:01:36.211587 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d682af0-d8d5-49da-a8a1-9d2ca8d20efb None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:01:36.276876 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:01:36.331116 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d682af0-d8d5-49da-a8a1-9d2ca8d20efb None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:01:36.374847 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5fe167-cef6-46ff-b3f5-0eede18a1643 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:01:36.375459 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5fe167-cef6-46ff-b3f5-0eede18a1643 None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:01:36.375737 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5fe167-cef6-46ff-b3f5-0eede18a1643 None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:01:36.376004 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5fe167-cef6-46ff-b3f5-0eede18a1643 None admin] PATH_INFO: `/v3/services` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:01:36.376632 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5fe167-cef6-46ff-b3f5-0eede18a1643 None admin] RBAC: Adding query filter params (type=network) {{(pid=81765) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:01:36.376929 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5fe167-cef6-46ff-b3f5-0eede18a1643 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:01:36.378442 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5fe167-cef6-46ff-b3f5-0eede18a1643 None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:01:36.383453 dv-cinder-862365-1-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 260/529] 10.222.0.23 () {56 vars in 1112 bytes} [Fri Oct 28 19:01:36 2022] GET /identity/v3/services?type=network => generated 124 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 19:01:37.461529 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edd3ba7-95df-4d0c-84f6-bc6d9b6bff37 None None] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:01:37.462055 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edd3ba7-95df-4d0c-84f6-bc6d9b6bff37 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:01:37.462134 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edd3ba7-95df-4d0c-84f6-bc6d9b6bff37 None None] PATH_INFO: `/` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:01:37.463813 dv-cinder-862365-1-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 270/530] 10.222.0.23 () {54 vars in 927 bytes} [Fri Oct 28 19:01:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 19:01:37.484540 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0101c2-f633-4f50-aedd-d493b5a23305 None None] REQUEST_METHOD: `POST` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:01:37.485077 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0101c2-f633-4f50-aedd-d493b5a23305 None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:01:37.485077 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0101c2-f633-4f50-aedd-d493b5a23305 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:01:37.510929 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.auth.core [None req-9c0101c2-f633-4f50-aedd-d493b5a23305 None None] MFA Rules not processed for user `ae863915635746d1ac19970949de4722`. Rule list: `[]` (Enabled: `True`). {{(pid=81765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:01:37.512132 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-9c0101c2-f633-4f50-aedd-d493b5a23305 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:01:37.607016 dv-cinder-862365-1-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 261/531] 10.222.0.23 () {58 vars in 1024 bytes} [Fri Oct 28 19:01:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 28 19:01:38.000118 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0edd3ba7-95df-4d0c-84f6-bc6d9b6bff37 None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:01:38.096359 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:01:38.117893 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0edd3ba7-95df-4d0c-84f6-bc6d9b6bff37 None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:01:38.125510 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d2db03-7ca7-4c05-bd0a-654f1f0aee0e None None] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:01:38.125804 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d2db03-7ca7-4c05-bd0a-654f1f0aee0e None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:01:38.126085 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d2db03-7ca7-4c05-bd0a-654f1f0aee0e None None] PATH_INFO: `/` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:01:38.127774 dv-cinder-862365-1-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 262/532] 10.222.0.23 () {54 vars in 927 bytes} [Fri Oct 28 19:01:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 19:01:38.132814 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee4a904-3db8-4289-a6d3-31a76480eb86 None None] REQUEST_METHOD: `POST` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:01:38.133102 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee4a904-3db8-4289-a6d3-31a76480eb86 None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:01:38.133402 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee4a904-3db8-4289-a6d3-31a76480eb86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:01:38.169835 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.auth.core [None req-6ee4a904-3db8-4289-a6d3-31a76480eb86 None None] MFA Rules not processed for user `ae863915635746d1ac19970949de4722`. Rule list: `[]` (Enabled: `True`). {{(pid=81765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:01:38.171471 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-6ee4a904-3db8-4289-a6d3-31a76480eb86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:01:38.174791 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60282b7-1257-4822-9a07-0d91f711942d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:01:38.175424 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60282b7-1257-4822-9a07-0d91f711942d None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:01:38.175688 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60282b7-1257-4822-9a07-0d91f711942d None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:01:38.175954 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60282b7-1257-4822-9a07-0d91f711942d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:01:38.193634 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60282b7-1257-4822-9a07-0d91f711942d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 19:01:38.198904 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application [None req-f60282b7-1257-4822-9a07-0d91f711942d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 28 19:01:38.198904 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 19:01:38.198904 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 19:01:38.198904 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 19:01:38.198904 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 19:01:38.198904 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 19:01:38.198904 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 19:01:38.198904 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 19:01:38.198904 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 19:01:38.198904 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 19:01:38.198904 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 19:01:38.198904 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 19:01:38.198904 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 28 19:01:38.198904 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 28 19:01:38.198904 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 28 19:01:38.198904 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 28 19:01:38.199807 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 28 19:01:38.199807 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 28 19:01:38.199807 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 28 19:01:38.199807 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 28 19:01:38.199807 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 19:01:38.199807 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 19:01:38.199807 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 19:01:38.199807 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 19:01:38.199807 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 19:01:38.199807 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 19:01:38.199807 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 19:01:38.199807 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application with Lock( Oct 28 19:01:38.199807 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 19:01:38.199807 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._enter() Oct 28 19:01:38.199807 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 19:01:38.199807 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 19:01:38.200617 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 19:01:38.200617 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.creator() Oct 28 19:01:38.200617 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 19:01:38.200617 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application created_value = creator( Oct 28 19:01:38.200617 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 28 19:01:38.200617 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 28 19:01:38.200617 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 28 19:01:38.200617 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 28 19:01:38.200617 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 28 19:01:38.200617 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 28 19:01:38.200617 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 28 19:01:38.200617 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Oct 28 19:01:38.201797 dv-cinder-862365-1-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 271/533] 10.222.0.23 () {56 vars in 1096 bytes} [Fri Oct 28 19:01:37 2022] GET /identity/v3/roles/admin => generated 83 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 19:01:38.206087 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60282b7-1257-4822-9a07-0d91f711942d None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:01:38.261771 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:01:38.293049 dv-cinder-862365-1-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 263/534] 10.222.0.23 () {58 vars in 1024 bytes} [Fri Oct 28 19:01:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 28 19:01:38.375146 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60282b7-1257-4822-9a07-0d91f711942d None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:01:38.423866 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73508c8b-2932-423d-99b8-6f08cf5c51cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:01:38.424460 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73508c8b-2932-423d-99b8-6f08cf5c51cd None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:01:38.424738 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73508c8b-2932-423d-99b8-6f08cf5c51cd None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:01:38.425009 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73508c8b-2932-423d-99b8-6f08cf5c51cd None admin] PATH_INFO: `/v3/roles` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:01:38.425713 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73508c8b-2932-423d-99b8-6f08cf5c51cd None admin] RBAC: Adding query filter params (name=admin) {{(pid=81766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:01:38.426015 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73508c8b-2932-423d-99b8-6f08cf5c51cd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:01:38.427367 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73508c8b-2932-423d-99b8-6f08cf5c51cd None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:01:38.440601 dv-cinder-862365-1-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 272/535] 10.222.0.23 () {56 vars in 1099 bytes} [Fri Oct 28 19:01:38 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:01:38.446429 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee4a904-3db8-4289-a6d3-31a76480eb86 None None] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:01:38.571557 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee4a904-3db8-4289-a6d3-31a76480eb86 None None] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:01:38.609384 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8853656f-1a16-4056-b04e-d5b82cf81307 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:01:38.610372 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8853656f-1a16-4056-b04e-d5b82cf81307 None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:01:38.610870 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8853656f-1a16-4056-b04e-d5b82cf81307 None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:01:38.611347 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8853656f-1a16-4056-b04e-d5b82cf81307 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:01:38.622005 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8853656f-1a16-4056-b04e-d5b82cf81307 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:01:38.623853 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8853656f-1a16-4056-b04e-d5b82cf81307 None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:01:38.639452 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application [None req-8853656f-1a16-4056-b04e-d5b82cf81307 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 19:01:38.639452 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 19:01:38.639452 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 19:01:38.639452 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 19:01:38.639452 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 19:01:38.639452 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 19:01:38.639452 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 19:01:38.639452 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 19:01:38.639452 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 19:01:38.639452 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 19:01:38.639452 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 19:01:38.639452 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 19:01:38.639452 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 28 19:01:38.639452 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 28 19:01:38.639452 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 28 19:01:38.639452 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 28 19:01:38.640412 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 19:01:38.640412 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 19:01:38.640412 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 19:01:38.640412 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 19:01:38.640412 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 19:01:38.640412 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 19:01:38.640412 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 19:01:38.640412 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application with Lock( Oct 28 19:01:38.640412 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 19:01:38.640412 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._enter() Oct 28 19:01:38.640412 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 19:01:38.640412 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 19:01:38.640412 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 19:01:38.640412 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.creator() Oct 28 19:01:38.640412 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 19:01:38.640412 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application created_value = creator( Oct 28 19:01:38.640412 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 28 19:01:38.641312 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 28 19:01:38.641312 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 19:01:38.641312 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application Oct 28 19:01:38.643328 dv-cinder-862365-1-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 264/536] 10.222.0.23 () {56 vars in 1108 bytes} [Fri Oct 28 19:01:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 19:01:38.651252 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73508c8b-2932-423d-99b8-6f08cf5c51cd None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:01:38.661698 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:01:38.682675 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8853656f-1a16-4056-b04e-d5b82cf81307 None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:01:38.731258 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:01:38.829379 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73508c8b-2932-423d-99b8-6f08cf5c51cd None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:01:38.844494 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8853656f-1a16-4056-b04e-d5b82cf81307 None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:01:38.897046 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be652f3-b37b-41ae-a54d-3d78419218da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:01:38.897958 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be652f3-b37b-41ae-a54d-3d78419218da None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:01:38.898344 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be652f3-b37b-41ae-a54d-3d78419218da None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:01:38.898728 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be652f3-b37b-41ae-a54d-3d78419218da None admin] PATH_INFO: `/v3/domains` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:01:38.899629 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be652f3-b37b-41ae-a54d-3d78419218da None admin] RBAC: Adding query filter params (name=Default) {{(pid=81766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:01:38.900047 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be652f3-b37b-41ae-a54d-3d78419218da None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:01:38.901046 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f378b557-2ddb-4d2e-92fb-46e1d0bf698b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:01:38.901726 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f378b557-2ddb-4d2e-92fb-46e1d0bf698b None admin] REQUEST_METHOD: `POST` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:01:38.902005 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f378b557-2ddb-4d2e-92fb-46e1d0bf698b None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:01:38.902118 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be652f3-b37b-41ae-a54d-3d78419218da None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:01:38.902376 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f378b557-2ddb-4d2e-92fb-46e1d0bf698b None admin] PATH_INFO: `/v3/services` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:01:38.902959 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f378b557-2ddb-4d2e-92fb-46e1d0bf698b None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:01:38.904871 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f378b557-2ddb-4d2e-92fb-46e1d0bf698b None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:01:38.917774 dv-cinder-862365-1-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 273/537] 10.222.0.23 () {56 vars in 1109 bytes} [Fri Oct 28 19:01:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:01:38.919301 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac46f43d-e2f2-4dfc-95fd-36ef29f13373 None None] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:01:38.919656 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac46f43d-e2f2-4dfc-95fd-36ef29f13373 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:01:38.920010 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac46f43d-e2f2-4dfc-95fd-36ef29f13373 None None] PATH_INFO: `/` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:01:38.921535 dv-cinder-862365-1-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 274/538] 10.222.0.23 () {54 vars in 927 bytes} [Fri Oct 28 19:01:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 19:01:38.926673 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac46f43d-e2f2-4dfc-95fd-36ef29f13373 None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:01:38.993186 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:01:39.016967 dv-cinder-862365-1-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 265/539] 10.222.0.23 () {60 vars in 1141 bytes} [Fri Oct 28 19:01:38 2022] POST /identity/v3/services => generated 251 bytes in 328 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 19:01:39.018556 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7ee58b-7aff-4013-ba1a-f45a0086b1b0 None None] REQUEST_METHOD: `POST` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:01:39.018841 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7ee58b-7aff-4013-ba1a-f45a0086b1b0 None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:01:39.019116 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7ee58b-7aff-4013-ba1a-f45a0086b1b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:01:39.040435 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.auth.core [None req-fb7ee58b-7aff-4013-ba1a-f45a0086b1b0 None None] MFA Rules not processed for user `ae863915635746d1ac19970949de4722`. Rule list: `[]` (Enabled: `True`). {{(pid=81765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:01:39.042401 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-fb7ee58b-7aff-4013-ba1a-f45a0086b1b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:01:39.054372 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac46f43d-e2f2-4dfc-95fd-36ef29f13373 None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:01:39.096436 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25e0205-3617-40bb-ae6f-b3745a420ade None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:01:39.097180 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25e0205-3617-40bb-ae6f-b3745a420ade None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:01:39.097493 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25e0205-3617-40bb-ae6f-b3745a420ade None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:01:39.097769 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25e0205-3617-40bb-ae6f-b3745a420ade None admin] PATH_INFO: `/v3/users/nova` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:01:39.106277 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25e0205-3617-40bb-ae6f-b3745a420ade None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:01:39.107763 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25e0205-3617-40bb-ae6f-b3745a420ade None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:01:39.122665 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application [None req-a25e0205-3617-40bb-ae6f-b3745a420ade None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 28 19:01:39.122665 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 19:01:39.122665 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 19:01:39.122665 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 19:01:39.122665 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 19:01:39.122665 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 19:01:39.122665 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 19:01:39.122665 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 19:01:39.122665 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 19:01:39.122665 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 19:01:39.122665 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 19:01:39.122665 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 19:01:39.122665 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 28 19:01:39.122665 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 28 19:01:39.122665 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 28 19:01:39.122665 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 28 19:01:39.123718 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 19:01:39.123718 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 19:01:39.123718 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 28 19:01:39.123718 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 28 19:01:39.123718 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 28 19:01:39.123718 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 28 19:01:39.123718 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 19:01:39.123718 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 19:01:39.123718 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 19:01:39.123718 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 19:01:39.123718 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 19:01:39.123718 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application with Lock( Oct 28 19:01:39.123718 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 19:01:39.123718 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._enter() Oct 28 19:01:39.123718 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 19:01:39.123718 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 19:01:39.123718 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 19:01:39.123718 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.creator() Oct 28 19:01:39.130317 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 19:01:39.130317 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application created_value = creator( Oct 28 19:01:39.130317 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 28 19:01:39.130317 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 28 19:01:39.130317 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 28 19:01:39.130317 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 28 19:01:39.130317 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 28 19:01:39.130317 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 28 19:01:39.130317 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 28 19:01:39.130317 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Oct 28 19:01:39.130317 dv-cinder-862365-1-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 275/540] 10.222.0.23 () {56 vars in 1093 bytes} [Fri Oct 28 19:01:38 2022] GET /identity/v3/users/nova => generated 82 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 19:01:39.130317 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742ff3aa-812d-4584-80b8-1e269db410a9 None None] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:01:39.130317 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742ff3aa-812d-4584-80b8-1e269db410a9 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:01:39.131021 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742ff3aa-812d-4584-80b8-1e269db410a9 None None] PATH_INFO: `/` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:01:39.131021 dv-cinder-862365-1-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 276/541] 10.222.0.23 () {54 vars in 927 bytes} [Fri Oct 28 19:01:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 19:01:39.131021 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf454ff8-3bf2-476f-ab68-79d33c4cf1d8 None None] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:01:39.131021 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf454ff8-3bf2-476f-ab68-79d33c4cf1d8 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:01:39.131021 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf454ff8-3bf2-476f-ab68-79d33c4cf1d8 None None] PATH_INFO: `/` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:01:39.131308 dv-cinder-862365-1-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 266/542] 10.222.0.23 () {58 vars in 1024 bytes} [Fri Oct 28 19:01:39 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 28 19:01:39.131308 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7ee58b-7aff-4013-ba1a-f45a0086b1b0 None None] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:01:39.135905 dv-cinder-862365-1-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 277/543] 10.222.0.23 () {54 vars in 927 bytes} [Fri Oct 28 19:01:39 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 19:01:39.137278 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a73663-3609-4525-a553-2c8548df83cb None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:01:39.137587 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a73663-3609-4525-a553-2c8548df83cb None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:01:39.137860 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a73663-3609-4525-a553-2c8548df83cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:01:39.157833 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-b1a73663-3609-4525-a553-2c8548df83cb None None] MFA Rules not processed for user `ae863915635746d1ac19970949de4722`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:01:39.158578 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-b1a73663-3609-4525-a553-2c8548df83cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:01:39.171635 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:01:39.246075 dv-cinder-862365-1-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 278/544] 10.222.0.23 () {58 vars in 1024 bytes} [Fri Oct 28 19:01:39 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 28 19:01:39.248472 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bfe3b9-2f78-4221-8400-0048d9366e1f None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:01:39.249074 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bfe3b9-2f78-4221-8400-0048d9366e1f None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:01:39.249656 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bfe3b9-2f78-4221-8400-0048d9366e1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:01:39.267120 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7ee58b-7aff-4013-ba1a-f45a0086b1b0 None None] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:01:39.274726 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-52bfe3b9-2f78-4221-8400-0048d9366e1f None None] MFA Rules not processed for user `ae863915635746d1ac19970949de4722`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:01:39.277423 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-52bfe3b9-2f78-4221-8400-0048d9366e1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:01:39.314072 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaeae877-e6d2-49d8-9ec6-e406c8854fe0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:01:39.315105 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaeae877-e6d2-49d8-9ec6-e406c8854fe0 None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:01:39.315613 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaeae877-e6d2-49d8-9ec6-e406c8854fe0 None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:01:39.316133 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaeae877-e6d2-49d8-9ec6-e406c8854fe0 None admin] PATH_INFO: `/v3/users` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:01:39.317187 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaeae877-e6d2-49d8-9ec6-e406c8854fe0 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81765) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:01:39.317695 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaeae877-e6d2-49d8-9ec6-e406c8854fe0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:01:39.320574 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaeae877-e6d2-49d8-9ec6-e406c8854fe0 None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:01:39.333854 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:01:39.348404 dv-cinder-862365-1-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 267/545] 10.222.0.23 () {56 vars in 1133 bytes} [Fri Oct 28 19:01:39 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:01:39.355926 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaeae877-e6d2-49d8-9ec6-e406c8854fe0 None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:01:39.372519 dv-cinder-862365-1-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 279/546] 10.222.0.23 () {58 vars in 1024 bytes} [Fri Oct 28 19:01:39 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 28 19:01:39.404799 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52bfe3b9-2f78-4221-8400-0048d9366e1f None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:01:39.462950 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:01:39.496094 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaeae877-e6d2-49d8-9ec6-e406c8854fe0 None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:01:39.550405 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52bfe3b9-2f78-4221-8400-0048d9366e1f None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:01:39.554755 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bad9c91-9fa8-49c5-a6ac-ac7f8b502895 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:01:39.555672 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bad9c91-9fa8-49c5-a6ac-ac7f8b502895 None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:01:39.561716 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bad9c91-9fa8-49c5-a6ac-ac7f8b502895 None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:01:39.562240 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bad9c91-9fa8-49c5-a6ac-ac7f8b502895 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:01:39.606371 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee654ae-8892-44eb-a8d6-343b3e513740 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:01:39.607067 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee654ae-8892-44eb-a8d6-343b3e513740 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:01:39.607345 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee654ae-8892-44eb-a8d6-343b3e513740 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:01:39.607616 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee654ae-8892-44eb-a8d6-343b3e513740 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:01:39.623994 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee654ae-8892-44eb-a8d6-343b3e513740 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 19:01:39.630768 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application [None req-2ee654ae-8892-44eb-a8d6-343b3e513740 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 28 19:01:39.630768 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 19:01:39.630768 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 19:01:39.630768 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 19:01:39.630768 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 19:01:39.630768 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 19:01:39.630768 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 19:01:39.630768 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 19:01:39.630768 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 19:01:39.630768 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 19:01:39.630768 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 19:01:39.630768 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 19:01:39.630768 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 28 19:01:39.630768 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 28 19:01:39.630768 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 28 19:01:39.630768 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 28 19:01:39.631718 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 28 19:01:39.631718 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 28 19:01:39.631718 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 28 19:01:39.631718 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 28 19:01:39.631718 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 19:01:39.631718 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 19:01:39.631718 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 19:01:39.631718 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 19:01:39.631718 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 19:01:39.631718 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 19:01:39.631718 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 19:01:39.631718 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application with Lock( Oct 28 19:01:39.631718 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 19:01:39.631718 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._enter() Oct 28 19:01:39.631718 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 19:01:39.631718 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 19:01:39.632531 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 19:01:39.632531 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.creator() Oct 28 19:01:39.632531 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 19:01:39.632531 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application created_value = creator( Oct 28 19:01:39.632531 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 28 19:01:39.632531 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 28 19:01:39.632531 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 28 19:01:39.632531 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 28 19:01:39.632531 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 28 19:01:39.632531 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 28 19:01:39.632531 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 28 19:01:39.632531 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Oct 28 19:01:39.641399 dv-cinder-862365-1-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 280/547] 10.222.0.23 () {56 vars in 1102 bytes} [Fri Oct 28 19:01:39 2022] GET /identity/v3/roles/service => generated 85 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 28 19:01:39.641399 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee654ae-8892-44eb-a8d6-343b3e513740 None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:01:39.656436 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bad9c91-9fa8-49c5-a6ac-ac7f8b502895 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:01:39.657998 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bad9c91-9fa8-49c5-a6ac-ac7f8b502895 None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:01:39.700388 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:01:39.750415 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:01:39.768703 dv-cinder-862365-1-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 268/548] 10.222.0.23 () {58 vars in 1282 bytes} [Fri Oct 28 19:01:39 2022] GET /identity/v3/auth/tokens => generated 903 bytes in 413 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Oct 28 19:01:39.769576 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee654ae-8892-44eb-a8d6-343b3e513740 None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:01:39.770058 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bad9c91-9fa8-49c5-a6ac-ac7f8b502895 None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:01:39.807486 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b321ced3-7587-4ed7-9a63-833f99650b4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:01:39.808251 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b321ced3-7587-4ed7-9a63-833f99650b4f None admin] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:01:39.808525 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b321ced3-7587-4ed7-9a63-833f99650b4f None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:01:39.809610 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b321ced3-7587-4ed7-9a63-833f99650b4f None admin] PATH_INFO: `/v3/services` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:01:39.810265 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b321ced3-7587-4ed7-9a63-833f99650b4f None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:01:39.811691 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b321ced3-7587-4ed7-9a63-833f99650b4f None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:01:39.880504 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bad9c91-9fa8-49c5-a6ac-ac7f8b502895 None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:01:39.908310 dv-cinder-862365-1-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 281/549] 10.222.0.23 () {60 vars in 1141 bytes} [Fri Oct 28 19:01:39 2022] POST /identity/v3/services => generated 240 bytes in 270 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 19:01:39.909474 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b321ced3-7587-4ed7-9a63-833f99650b4f None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:01:39.937626 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c30028-3bb4-471f-9978-94abeb403142 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:01:39.938552 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c30028-3bb4-471f-9978-94abeb403142 None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:01:39.939000 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c30028-3bb4-471f-9978-94abeb403142 None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:01:39.939436 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c30028-3bb4-471f-9978-94abeb403142 None admin] PATH_INFO: `/v3/roles` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:01:39.940308 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c30028-3bb4-471f-9978-94abeb403142 None admin] RBAC: Adding query filter params (name=service) {{(pid=81765) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:01:39.940790 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c30028-3bb4-471f-9978-94abeb403142 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:01:39.942403 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c30028-3bb4-471f-9978-94abeb403142 None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:01:39.953071 dv-cinder-862365-1-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 269/550] 10.222.0.23 () {56 vars in 1103 bytes} [Fri Oct 28 19:01:39 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:01:39.954397 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c30028-3bb4-471f-9978-94abeb403142 None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:01:40.009025 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:01:40.066133 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b321ced3-7587-4ed7-9a63-833f99650b4f None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:01:40.085518 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c30028-3bb4-471f-9978-94abeb403142 None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:01:40.090390 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:01:40.120215 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc54048-0416-4f97-af6c-809ee884cdff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:01:40.120939 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc54048-0416-4f97-af6c-809ee884cdff None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:01:40.121219 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc54048-0416-4f97-af6c-809ee884cdff None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:01:40.121532 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc54048-0416-4f97-af6c-809ee884cdff None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:01:40.129867 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f0c72c-6ec8-4003-acf5-7b965a4c1f28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:01:40.130499 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f0c72c-6ec8-4003-acf5-7b965a4c1f28 None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:01:40.130777 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f0c72c-6ec8-4003-acf5-7b965a4c1f28 None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:01:40.131052 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f0c72c-6ec8-4003-acf5-7b965a4c1f28 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:01:40.136665 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc54048-0416-4f97-af6c-809ee884cdff None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 19:01:40.142530 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application [None req-5bc54048-0416-4f97-af6c-809ee884cdff None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 28 19:01:40.142530 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 19:01:40.142530 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 19:01:40.142530 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 19:01:40.142530 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 19:01:40.142530 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 19:01:40.142530 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 19:01:40.142530 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 19:01:40.142530 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 19:01:40.142530 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 19:01:40.142530 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 19:01:40.142530 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 19:01:40.142530 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 28 19:01:40.142530 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 28 19:01:40.142530 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 28 19:01:40.142530 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 28 19:01:40.143476 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 28 19:01:40.143476 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 28 19:01:40.143476 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 28 19:01:40.143476 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 28 19:01:40.143476 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 19:01:40.143476 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 19:01:40.143476 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 19:01:40.143476 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 19:01:40.143476 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 19:01:40.143476 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 19:01:40.143476 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 19:01:40.143476 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application with Lock( Oct 28 19:01:40.143476 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 19:01:40.143476 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._enter() Oct 28 19:01:40.143476 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 19:01:40.143476 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 19:01:40.144320 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 19:01:40.144320 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.creator() Oct 28 19:01:40.144320 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 19:01:40.144320 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application created_value = creator( Oct 28 19:01:40.144320 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 28 19:01:40.144320 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 28 19:01:40.144320 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 28 19:01:40.144320 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 28 19:01:40.144320 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 28 19:01:40.144320 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 28 19:01:40.144320 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 28 19:01:40.144320 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Oct 28 19:01:40.147397 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f0c72c-6ec8-4003-acf5-7b965a4c1f28 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:01:40.148830 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f0c72c-6ec8-4003-acf5-7b965a4c1f28 None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:01:40.149482 dv-cinder-862365-1-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 282/551] 10.222.0.23 () {56 vars in 1096 bytes} [Fri Oct 28 19:01:39 2022] GET /identity/v3/roles/admin => generated 83 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 19:01:40.150129 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc54048-0416-4f97-af6c-809ee884cdff None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:01:40.168246 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application [None req-01f0c72c-6ec8-4003-acf5-7b965a4c1f28 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 19:01:40.168246 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 19:01:40.168246 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 19:01:40.168246 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 19:01:40.168246 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 19:01:40.168246 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 19:01:40.168246 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 19:01:40.168246 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 19:01:40.168246 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 19:01:40.168246 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 19:01:40.168246 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 19:01:40.168246 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 19:01:40.168246 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 28 19:01:40.168246 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 28 19:01:40.168246 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 28 19:01:40.168246 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 28 19:01:40.169477 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 19:01:40.169477 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 19:01:40.169477 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 19:01:40.169477 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 19:01:40.169477 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 19:01:40.169477 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 19:01:40.169477 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 19:01:40.169477 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application with Lock( Oct 28 19:01:40.169477 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 19:01:40.169477 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._enter() Oct 28 19:01:40.169477 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 19:01:40.169477 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 19:01:40.169477 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 19:01:40.169477 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.creator() Oct 28 19:01:40.169477 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 19:01:40.169477 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application created_value = creator( Oct 28 19:01:40.169477 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 28 19:01:40.170583 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 28 19:01:40.170583 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 19:01:40.170583 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application Oct 28 19:01:40.173675 dv-cinder-862365-1-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 270/552] 10.222.0.23 () {56 vars in 1108 bytes} [Fri Oct 28 19:01:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 19:01:40.174489 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f0c72c-6ec8-4003-acf5-7b965a4c1f28 None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:01:40.276753 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:01:40.287293 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc54048-0416-4f97-af6c-809ee884cdff None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:01:40.291477 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f0c72c-6ec8-4003-acf5-7b965a4c1f28 None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:01:40.323345 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1afb80a4-4cfe-4235-ae3b-00daf32a28e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:01:40.324005 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afb80a4-4cfe-4235-ae3b-00daf32a28e5 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:01:40.324280 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afb80a4-4cfe-4235-ae3b-00daf32a28e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:01:40.324550 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afb80a4-4cfe-4235-ae3b-00daf32a28e5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:01:40.335451 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1afb80a4-4cfe-4235-ae3b-00daf32a28e5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:01:40.337092 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1afb80a4-4cfe-4235-ae3b-00daf32a28e5 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:01:40.341003 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277da52f-0e5a-4c19-9e82-6bb0cbf51f01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:01:40.341886 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277da52f-0e5a-4c19-9e82-6bb0cbf51f01 None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:01:40.342367 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277da52f-0e5a-4c19-9e82-6bb0cbf51f01 None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:01:40.342859 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277da52f-0e5a-4c19-9e82-6bb0cbf51f01 None admin] PATH_INFO: `/v3/roles` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:01:40.344272 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-277da52f-0e5a-4c19-9e82-6bb0cbf51f01 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81765) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:01:40.344794 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-277da52f-0e5a-4c19-9e82-6bb0cbf51f01 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:01:40.347208 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-277da52f-0e5a-4c19-9e82-6bb0cbf51f01 None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:01:40.351823 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application [None req-1afb80a4-4cfe-4235-ae3b-00daf32a28e5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 19:01:40.351823 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 19:01:40.351823 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 19:01:40.351823 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 19:01:40.351823 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 19:01:40.351823 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 19:01:40.351823 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 19:01:40.351823 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 19:01:40.351823 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 19:01:40.351823 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 19:01:40.351823 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 19:01:40.351823 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 19:01:40.351823 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 28 19:01:40.351823 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 28 19:01:40.351823 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 28 19:01:40.351823 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 28 19:01:40.352779 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 19:01:40.352779 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 19:01:40.352779 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 19:01:40.352779 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 19:01:40.352779 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 19:01:40.352779 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 19:01:40.352779 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 19:01:40.352779 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application with Lock( Oct 28 19:01:40.352779 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 19:01:40.352779 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._enter() Oct 28 19:01:40.352779 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 19:01:40.352779 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 19:01:40.352779 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 19:01:40.352779 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.creator() Oct 28 19:01:40.352779 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 19:01:40.352779 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application created_value = creator( Oct 28 19:01:40.352779 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 28 19:01:40.353747 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 28 19:01:40.353747 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 19:01:40.353747 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Oct 28 19:01:40.357543 dv-cinder-862365-1-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 283/553] 10.222.0.23 () {56 vars in 1108 bytes} [Fri Oct 28 19:01:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 19:01:40.358459 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1afb80a4-4cfe-4235-ae3b-00daf32a28e5 None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:01:40.359765 dv-cinder-862365-1-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 271/554] 10.222.0.23 () {56 vars in 1099 bytes} [Fri Oct 28 19:01:40 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:01:40.360863 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277da52f-0e5a-4c19-9e82-6bb0cbf51f01 None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:01:40.379022 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:01:40.489830 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277da52f-0e5a-4c19-9e82-6bb0cbf51f01 None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:01:40.496186 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1afb80a4-4cfe-4235-ae3b-00daf32a28e5 None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:01:40.530016 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f4826d-e011-45c3-bfd6-182c9bc8b715 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:01:40.530547 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f4826d-e011-45c3-bfd6-182c9bc8b715 None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:01:40.530834 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f4826d-e011-45c3-bfd6-182c9bc8b715 None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:01:40.531110 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f4826d-e011-45c3-bfd6-182c9bc8b715 None admin] PATH_INFO: `/v3/domains` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:01:40.531759 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f4826d-e011-45c3-bfd6-182c9bc8b715 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81765) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:01:40.532064 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f4826d-e011-45c3-bfd6-182c9bc8b715 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:01:40.534379 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f4826d-e011-45c3-bfd6-182c9bc8b715 None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:01:40.538798 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c872d9-cbe2-439b-a1f7-410c77c8a579 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:01:40.539575 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c872d9-cbe2-439b-a1f7-410c77c8a579 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:01:40.539925 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c872d9-cbe2-439b-a1f7-410c77c8a579 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:01:40.540271 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c872d9-cbe2-439b-a1f7-410c77c8a579 None admin] PATH_INFO: `/v3/domains` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:01:40.540975 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c872d9-cbe2-439b-a1f7-410c77c8a579 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:01:40.542542 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c872d9-cbe2-439b-a1f7-410c77c8a579 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:01:40.544516 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c872d9-cbe2-439b-a1f7-410c77c8a579 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:01:40.547378 dv-cinder-862365-1-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 272/555] 10.222.0.23 () {56 vars in 1109 bytes} [Fri Oct 28 19:01:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:01:40.548167 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f4826d-e011-45c3-bfd6-182c9bc8b715 None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:01:40.563373 dv-cinder-862365-1-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 284/556] 10.222.0.23 () {56 vars in 1109 bytes} [Fri Oct 28 19:01:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:01:40.564376 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c872d9-cbe2-439b-a1f7-410c77c8a579 None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:01:40.571475 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:01:40.641136 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:01:40.664745 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f4826d-e011-45c3-bfd6-182c9bc8b715 None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:01:40.678249 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c872d9-cbe2-439b-a1f7-410c77c8a579 None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:01:40.700493 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e947957-46f8-4fc8-8f4f-4b24ef9fe63d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:01:40.701303 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e947957-46f8-4fc8-8f4f-4b24ef9fe63d None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:01:40.701723 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e947957-46f8-4fc8-8f4f-4b24ef9fe63d None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:01:40.702099 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e947957-46f8-4fc8-8f4f-4b24ef9fe63d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:01:40.713055 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e947957-46f8-4fc8-8f4f-4b24ef9fe63d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:01:40.714682 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e947957-46f8-4fc8-8f4f-4b24ef9fe63d None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:01:40.718630 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f778748f-7898-4ea6-9662-e03e5bafa633 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:01:40.719345 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f778748f-7898-4ea6-9662-e03e5bafa633 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:01:40.719702 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f778748f-7898-4ea6-9662-e03e5bafa633 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:01:40.720048 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f778748f-7898-4ea6-9662-e03e5bafa633 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:01:40.728074 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f778748f-7898-4ea6-9662-e03e5bafa633 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:01:40.730218 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f778748f-7898-4ea6-9662-e03e5bafa633 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:01:40.731654 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application [None req-9e947957-46f8-4fc8-8f4f-4b24ef9fe63d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 19:01:40.731654 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 19:01:40.731654 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 19:01:40.731654 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 19:01:40.731654 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 19:01:40.731654 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 19:01:40.731654 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 19:01:40.731654 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 19:01:40.731654 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 19:01:40.731654 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 19:01:40.731654 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 19:01:40.731654 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 19:01:40.731654 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 28 19:01:40.731654 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 28 19:01:40.731654 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 28 19:01:40.731654 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 28 19:01:40.733177 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 19:01:40.733177 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 19:01:40.733177 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 19:01:40.733177 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 19:01:40.733177 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 19:01:40.733177 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 19:01:40.733177 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 19:01:40.733177 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application with Lock( Oct 28 19:01:40.733177 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 19:01:40.733177 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._enter() Oct 28 19:01:40.733177 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 19:01:40.733177 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 19:01:40.733177 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 19:01:40.733177 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.creator() Oct 28 19:01:40.733177 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 19:01:40.733177 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application created_value = creator( Oct 28 19:01:40.733177 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 28 19:01:40.735313 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 28 19:01:40.735313 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 19:01:40.735313 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application Oct 28 19:01:40.735313 dv-cinder-862365-1-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 273/557] 10.222.0.23 () {56 vars in 1108 bytes} [Fri Oct 28 19:01:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 19:01:40.735313 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e947957-46f8-4fc8-8f4f-4b24ef9fe63d None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:01:40.749119 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application [None req-f778748f-7898-4ea6-9662-e03e5bafa633 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 28 19:01:40.749119 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 19:01:40.749119 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 19:01:40.749119 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 19:01:40.749119 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 19:01:40.749119 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 19:01:40.749119 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 19:01:40.749119 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 19:01:40.749119 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 19:01:40.749119 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 19:01:40.749119 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 19:01:40.749119 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 19:01:40.749119 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 28 19:01:40.749119 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 28 19:01:40.749119 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 28 19:01:40.749119 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 28 19:01:40.751351 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 19:01:40.751351 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 19:01:40.751351 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 28 19:01:40.751351 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 28 19:01:40.751351 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 28 19:01:40.751351 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 28 19:01:40.751351 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 19:01:40.751351 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 19:01:40.751351 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 19:01:40.751351 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 19:01:40.751351 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 19:01:40.751351 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application with Lock( Oct 28 19:01:40.751351 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 19:01:40.751351 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._enter() Oct 28 19:01:40.751351 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 19:01:40.751351 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 19:01:40.751351 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 19:01:40.751351 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.creator() Oct 28 19:01:40.753543 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 19:01:40.753543 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application created_value = creator( Oct 28 19:01:40.753543 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 28 19:01:40.753543 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 28 19:01:40.753543 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 28 19:01:40.753543 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 28 19:01:40.753543 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 28 19:01:40.753543 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 28 19:01:40.753543 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 28 19:01:40.753543 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Oct 28 19:01:40.753543 dv-cinder-862365-1-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 285/558] 10.222.0.23 () {56 vars in 1117 bytes} [Fri Oct 28 19:01:40 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 19:01:40.753543 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f778748f-7898-4ea6-9662-e03e5bafa633 None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:01:40.802356 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:01:40.842214 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e947957-46f8-4fc8-8f4f-4b24ef9fe63d None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:01:40.867652 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f778748f-7898-4ea6-9662-e03e5bafa633 None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:01:40.881730 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b24687-cdb5-463f-a303-15cb12ccc522 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:01:40.882382 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b24687-cdb5-463f-a303-15cb12ccc522 None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:01:40.882728 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b24687-cdb5-463f-a303-15cb12ccc522 None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:01:40.882930 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b24687-cdb5-463f-a303-15cb12ccc522 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:01:40.890648 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b24687-cdb5-463f-a303-15cb12ccc522 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:01:40.892116 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b24687-cdb5-463f-a303-15cb12ccc522 None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:01:40.903690 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application [None req-e8b24687-cdb5-463f-a303-15cb12ccc522 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 28 19:01:40.903690 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 19:01:40.903690 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 19:01:40.903690 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 19:01:40.903690 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 19:01:40.903690 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 19:01:40.903690 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 19:01:40.903690 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 19:01:40.903690 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 19:01:40.903690 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 19:01:40.903690 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 19:01:40.903690 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 19:01:40.903690 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 28 19:01:40.903690 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 28 19:01:40.903690 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 28 19:01:40.904932 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 28 19:01:40.904932 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 19:01:40.904932 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 19:01:40.904932 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 19:01:40.904932 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 19:01:40.904932 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 19:01:40.904932 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 19:01:40.904932 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 19:01:40.904932 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application with Lock( Oct 28 19:01:40.904932 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 19:01:40.904932 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._enter() Oct 28 19:01:40.904932 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 19:01:40.904932 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 19:01:40.904932 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 19:01:40.904932 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.creator() Oct 28 19:01:40.904932 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 19:01:40.904932 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application created_value = creator( Oct 28 19:01:40.906168 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 28 19:01:40.906168 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 28 19:01:40.906168 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 28 19:01:40.906168 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 28 19:01:40.906168 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 28 19:01:40.906168 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 28 19:01:40.906168 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 28 19:01:40.906168 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application Oct 28 19:01:40.906168 dv-cinder-862365-1-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 274/559] 10.222.0.23 () {56 vars in 1111 bytes} [Fri Oct 28 19:01:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 19:01:40.906168 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b24687-cdb5-463f-a303-15cb12ccc522 None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:01:40.907042 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:01:40.913823 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5afc54a-7a2f-4043-aaa2-9faf2daad0ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:01:40.914698 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5afc54a-7a2f-4043-aaa2-9faf2daad0ed None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:01:40.915125 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5afc54a-7a2f-4043-aaa2-9faf2daad0ed None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:01:40.915556 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5afc54a-7a2f-4043-aaa2-9faf2daad0ed None admin] PATH_INFO: `/v3/domains` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:01:40.917068 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5afc54a-7a2f-4043-aaa2-9faf2daad0ed None admin] RBAC: Adding query filter params (name=Default) {{(pid=81766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:01:40.917583 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5afc54a-7a2f-4043-aaa2-9faf2daad0ed None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:01:40.919228 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5afc54a-7a2f-4043-aaa2-9faf2daad0ed None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:01:40.940337 dv-cinder-862365-1-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 286/560] 10.222.0.23 () {56 vars in 1109 bytes} [Fri Oct 28 19:01:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:01:40.941492 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5afc54a-7a2f-4043-aaa2-9faf2daad0ed None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:01:41.009188 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b24687-cdb5-463f-a303-15cb12ccc522 None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:01:41.035856 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:01:41.044074 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be822cb-f838-4f5c-aa59-10956d84eebb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:01:41.044689 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be822cb-f838-4f5c-aa59-10956d84eebb None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:01:41.044968 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be822cb-f838-4f5c-aa59-10956d84eebb None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:01:41.045253 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be822cb-f838-4f5c-aa59-10956d84eebb None admin] PATH_INFO: `/v3/users` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:01:41.047781 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be822cb-f838-4f5c-aa59-10956d84eebb None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81765) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:01:41.047781 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be822cb-f838-4f5c-aa59-10956d84eebb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:01:41.047781 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be822cb-f838-4f5c-aa59-10956d84eebb None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:01:41.055144 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5afc54a-7a2f-4043-aaa2-9faf2daad0ed None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:01:41.065881 dv-cinder-862365-1-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 275/561] 10.222.0.23 () {56 vars in 1149 bytes} [Fri Oct 28 19:01:40 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:01:41.066727 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be822cb-f838-4f5c-aa59-10956d84eebb None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:01:41.096026 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2620a129-bfa4-4219-81c4-4ce1fcdf47a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:01:41.096945 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2620a129-bfa4-4219-81c4-4ce1fcdf47a4 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:01:41.097476 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2620a129-bfa4-4219-81c4-4ce1fcdf47a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:01:41.098027 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2620a129-bfa4-4219-81c4-4ce1fcdf47a4 None admin] PATH_INFO: `/v3/projects` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:01:41.099104 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2620a129-bfa4-4219-81c4-4ce1fcdf47a4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:01:41.099591 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2620a129-bfa4-4219-81c4-4ce1fcdf47a4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:01:41.101269 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2620a129-bfa4-4219-81c4-4ce1fcdf47a4 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:01:41.115832 dv-cinder-862365-1-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 287/562] 10.222.0.23 () {56 vars in 1148 bytes} [Fri Oct 28 19:01:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:01:41.117024 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2620a129-bfa4-4219-81c4-4ce1fcdf47a4 None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:01:41.171102 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be822cb-f838-4f5c-aa59-10956d84eebb None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:01:41.177853 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:01:41.211488 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0818c7-3317-42ca-a3ac-0675511e27f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:01:41.212144 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0818c7-3317-42ca-a3ac-0675511e27f4 None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:01:41.212474 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0818c7-3317-42ca-a3ac-0675511e27f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:01:41.212749 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0818c7-3317-42ca-a3ac-0675511e27f4 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:01:41.221839 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a0818c7-3317-42ca-a3ac-0675511e27f4 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:01:41.223350 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a0818c7-3317-42ca-a3ac-0675511e27f4 None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:01:41.232794 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2620a129-bfa4-4219-81c4-4ce1fcdf47a4 None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:01:41.236950 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application [None req-9a0818c7-3317-42ca-a3ac-0675511e27f4 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Oct 28 19:01:41.236950 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 19:01:41.236950 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 19:01:41.236950 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 19:01:41.236950 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 19:01:41.236950 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 19:01:41.236950 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 19:01:41.236950 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 19:01:41.236950 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 19:01:41.236950 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 19:01:41.236950 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 19:01:41.236950 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 19:01:41.236950 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 28 19:01:41.236950 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 28 19:01:41.236950 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 28 19:01:41.236950 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 28 19:01:41.237936 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 19:01:41.237936 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 19:01:41.237936 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 28 19:01:41.237936 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 28 19:01:41.237936 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 28 19:01:41.237936 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 28 19:01:41.237936 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 19:01:41.237936 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 19:01:41.237936 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 19:01:41.237936 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 19:01:41.237936 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 19:01:41.237936 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application with Lock( Oct 28 19:01:41.237936 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 19:01:41.237936 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._enter() Oct 28 19:01:41.237936 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 19:01:41.237936 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 19:01:41.237936 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 19:01:41.237936 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.creator() Oct 28 19:01:41.239042 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 19:01:41.239042 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application created_value = creator( Oct 28 19:01:41.239042 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 28 19:01:41.239042 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 28 19:01:41.239042 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 28 19:01:41.239042 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 28 19:01:41.239042 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 28 19:01:41.239042 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 28 19:01:41.239042 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Oct 28 19:01:41.239042 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application Oct 28 19:01:41.239042 dv-cinder-862365-1-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 276/563] 10.222.0.23 () {56 vars in 1096 bytes} [Fri Oct 28 19:01:41 2022] GET /identity/v3/users/swift => generated 83 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 19:01:41.239042 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0818c7-3317-42ca-a3ac-0675511e27f4 None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:01:41.275415 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc17c52-fdb0-45c7-b50d-eaca2914bf56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:01:41.276539 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc17c52-fdb0-45c7-b50d-eaca2914bf56 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:01:41.277165 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc17c52-fdb0-45c7-b50d-eaca2914bf56 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:01:41.277775 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc17c52-fdb0-45c7-b50d-eaca2914bf56 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:01:41.289638 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc17c52-fdb0-45c7-b50d-eaca2914bf56 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:01:41.291644 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc17c52-fdb0-45c7-b50d-eaca2914bf56 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:01:41.295067 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:01:41.310555 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application [None req-6fc17c52-fdb0-45c7-b50d-eaca2914bf56 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 19:01:41.310555 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 19:01:41.310555 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 19:01:41.310555 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 19:01:41.310555 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 19:01:41.310555 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 19:01:41.310555 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 19:01:41.310555 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 19:01:41.310555 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 19:01:41.310555 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 19:01:41.310555 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 19:01:41.310555 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 19:01:41.310555 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 28 19:01:41.310555 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 28 19:01:41.310555 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 28 19:01:41.310555 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 28 19:01:41.311581 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 19:01:41.311581 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 19:01:41.311581 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 19:01:41.311581 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 19:01:41.311581 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 19:01:41.311581 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 19:01:41.311581 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 19:01:41.311581 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application with Lock( Oct 28 19:01:41.311581 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 19:01:41.311581 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._enter() Oct 28 19:01:41.311581 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 19:01:41.311581 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 19:01:41.311581 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 19:01:41.311581 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.creator() Oct 28 19:01:41.311581 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 19:01:41.311581 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application created_value = creator( Oct 28 19:01:41.311581 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 28 19:01:41.312463 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 28 19:01:41.312463 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 19:01:41.312463 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Oct 28 19:01:41.314881 dv-cinder-862365-1-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 288/564] 10.222.0.23 () {56 vars in 1108 bytes} [Fri Oct 28 19:01:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 19:01:41.316274 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc17c52-fdb0-45c7-b50d-eaca2914bf56 None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:01:41.361077 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0818c7-3317-42ca-a3ac-0675511e27f4 None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:01:41.402037 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a6164a-d5b9-4caf-b171-0a269db62de8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:01:41.402647 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a6164a-d5b9-4caf-b171-0a269db62de8 None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:01:41.402927 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a6164a-d5b9-4caf-b171-0a269db62de8 None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:01:41.403197 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a6164a-d5b9-4caf-b171-0a269db62de8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:01:41.404035 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a6164a-d5b9-4caf-b171-0a269db62de8 None admin] RBAC: Adding query filter params (role.id=a9e4e47c2bf448fcbada91c1174644f7, scope.project.id=b705897907f042c0818a931052438e1e, user.id=8877180cd9844dad8b0980de34769ec8) {{(pid=81765) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:01:41.404349 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a6164a-d5b9-4caf-b171-0a269db62de8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:01:41.405899 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a6164a-d5b9-4caf-b171-0a269db62de8 None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:01:41.412593 dv-cinder-862365-1-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 277/565] 10.222.0.23 () {56 vars in 1374 bytes} [Fri Oct 28 19:01:41 2022] GET /identity/v3/role_assignments?user.id=8877180cd9844dad8b0980de34769ec8&scope.project.id=b705897907f042c0818a931052438e1e&role.id=a9e4e47c2bf448fcbada91c1174644f7 => generated 608 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:01:41.413414 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a6164a-d5b9-4caf-b171-0a269db62de8 None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:01:41.445190 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc17c52-fdb0-45c7-b50d-eaca2914bf56 None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:01:41.448717 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:01:41.495611 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1709da85-83fe-4bcb-9663-5c2c87536111 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:01:41.496338 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1709da85-83fe-4bcb-9663-5c2c87536111 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:01:41.496691 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1709da85-83fe-4bcb-9663-5c2c87536111 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:01:41.497310 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1709da85-83fe-4bcb-9663-5c2c87536111 None admin] PATH_INFO: `/v3/users` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:01:41.498671 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1709da85-83fe-4bcb-9663-5c2c87536111 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:01:41.499064 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1709da85-83fe-4bcb-9663-5c2c87536111 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:01:41.501239 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1709da85-83fe-4bcb-9663-5c2c87536111 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:01:41.528663 dv-cinder-862365-1-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 289/566] 10.222.0.23 () {56 vars in 1135 bytes} [Fri Oct 28 19:01:41 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:01:41.530638 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cce656-78cb-488a-b9e2-308f430122ce None None] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:01:41.531005 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cce656-78cb-488a-b9e2-308f430122ce None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:01:41.531352 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cce656-78cb-488a-b9e2-308f430122ce None None] PATH_INFO: `/` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:01:41.537298 dv-cinder-862365-1-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 290/567] 10.222.0.23 () {54 vars in 927 bytes} [Fri Oct 28 19:01:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 19:01:41.537298 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70cce656-78cb-488a-b9e2-308f430122ce None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:01:41.553628 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a6164a-d5b9-4caf-b171-0a269db62de8 None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:01:41.568608 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:01:41.598646 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c328bd-1c48-4d82-b83b-230a11e5e00d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:01:41.599549 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c328bd-1c48-4d82-b83b-230a11e5e00d None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:01:41.599980 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c328bd-1c48-4d82-b83b-230a11e5e00d None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:01:41.600698 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c328bd-1c48-4d82-b83b-230a11e5e00d None admin] PATH_INFO: `/v3/domains` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:01:41.602065 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c328bd-1c48-4d82-b83b-230a11e5e00d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81765) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:01:41.602529 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c328bd-1c48-4d82-b83b-230a11e5e00d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:01:41.605024 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c328bd-1c48-4d82-b83b-230a11e5e00d None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:01:41.624440 dv-cinder-862365-1-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 278/568] 10.222.0.23 () {56 vars in 1109 bytes} [Fri Oct 28 19:01:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:01:41.626264 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc73bb93-157e-4002-be49-c5737dfea59c None None] REQUEST_METHOD: `POST` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:01:41.626549 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc73bb93-157e-4002-be49-c5737dfea59c None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:01:41.627092 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc73bb93-157e-4002-be49-c5737dfea59c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:01:41.646922 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.auth.core [None req-dc73bb93-157e-4002-be49-c5737dfea59c None None] MFA Rules not processed for user `ae863915635746d1ac19970949de4722`. Rule list: `[]` (Enabled: `True`). {{(pid=81765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:01:41.648094 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-dc73bb93-157e-4002-be49-c5737dfea59c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:01:41.677007 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70cce656-78cb-488a-b9e2-308f430122ce None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:01:41.717380 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a5ee85-38f4-4e18-b03a-d0580b4b5ad7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:01:41.718238 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a5ee85-38f4-4e18-b03a-d0580b4b5ad7 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:01:41.718620 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a5ee85-38f4-4e18-b03a-d0580b4b5ad7 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:01:41.718995 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a5ee85-38f4-4e18-b03a-d0580b4b5ad7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:01:41.732968 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a5ee85-38f4-4e18-b03a-d0580b4b5ad7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:01:41.734746 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a5ee85-38f4-4e18-b03a-d0580b4b5ad7 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:01:41.747224 dv-cinder-862365-1-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 279/569] 10.222.0.23 () {58 vars in 1024 bytes} [Fri Oct 28 19:01:41 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 28 19:01:41.753441 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application [None req-b7a5ee85-38f4-4e18-b03a-d0580b4b5ad7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 19:01:41.753441 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 19:01:41.753441 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 19:01:41.753441 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 19:01:41.753441 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 19:01:41.753441 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 19:01:41.753441 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 19:01:41.753441 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 19:01:41.753441 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 19:01:41.753441 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 19:01:41.753441 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 19:01:41.753441 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 19:01:41.753441 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 28 19:01:41.753441 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 28 19:01:41.753441 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 28 19:01:41.753441 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 28 19:01:41.754649 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 19:01:41.754649 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 19:01:41.754649 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 19:01:41.754649 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 19:01:41.754649 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 19:01:41.754649 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 19:01:41.754649 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 19:01:41.754649 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application with Lock( Oct 28 19:01:41.754649 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 19:01:41.754649 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._enter() Oct 28 19:01:41.754649 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 19:01:41.754649 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 19:01:41.754649 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 19:01:41.754649 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.creator() Oct 28 19:01:41.754649 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 19:01:41.754649 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application created_value = creator( Oct 28 19:01:41.754649 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 28 19:01:41.755763 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 28 19:01:41.755763 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 19:01:41.755763 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Oct 28 19:01:41.755763 dv-cinder-862365-1-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 291/570] 10.222.0.23 () {56 vars in 1108 bytes} [Fri Oct 28 19:01:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 19:01:41.756647 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a5ee85-38f4-4e18-b03a-d0580b4b5ad7 None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:01:41.762376 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc73bb93-157e-4002-be49-c5737dfea59c None None] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:01:41.774136 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:01:41.899362 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a5ee85-38f4-4e18-b03a-d0580b4b5ad7 None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:01:41.944214 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a38ce9-1f8f-4b29-a38e-c9f53b2bbaf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:01:41.945019 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a38ce9-1f8f-4b29-a38e-c9f53b2bbaf2 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:01:41.945554 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a38ce9-1f8f-4b29-a38e-c9f53b2bbaf2 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:01:41.946709 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a38ce9-1f8f-4b29-a38e-c9f53b2bbaf2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:01:41.959653 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a38ce9-1f8f-4b29-a38e-c9f53b2bbaf2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:01:41.961613 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a38ce9-1f8f-4b29-a38e-c9f53b2bbaf2 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:01:41.985835 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:01:41.987351 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application [None req-d3a38ce9-1f8f-4b29-a38e-c9f53b2bbaf2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 28 19:01:41.987351 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 19:01:41.987351 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 19:01:41.987351 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 19:01:41.987351 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 19:01:41.987351 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 19:01:41.987351 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 19:01:41.987351 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 19:01:41.987351 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 19:01:41.987351 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 19:01:41.987351 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 19:01:41.987351 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 19:01:41.987351 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 28 19:01:41.987351 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 28 19:01:41.987351 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 28 19:01:41.988500 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 28 19:01:41.988500 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 19:01:41.988500 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 19:01:41.988500 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 19:01:41.988500 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 19:01:41.988500 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 19:01:41.988500 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 19:01:41.988500 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 19:01:41.988500 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application with Lock( Oct 28 19:01:41.988500 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 19:01:41.988500 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._enter() Oct 28 19:01:41.988500 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 19:01:41.988500 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 19:01:41.988500 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 19:01:41.988500 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.creator() Oct 28 19:01:41.988500 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 19:01:41.988500 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application created_value = creator( Oct 28 19:01:41.989640 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 28 19:01:41.989640 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 28 19:01:41.989640 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 28 19:01:41.989640 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 28 19:01:41.989640 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 28 19:01:41.989640 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 28 19:01:41.989640 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 28 19:01:41.989640 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Oct 28 19:01:41.990198 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc73bb93-157e-4002-be49-c5737dfea59c None None] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:01:41.991067 dv-cinder-862365-1-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 292/571] 10.222.0.23 () {56 vars in 1111 bytes} [Fri Oct 28 19:01:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 19:01:41.997304 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a38ce9-1f8f-4b29-a38e-c9f53b2bbaf2 None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:01:42.048751 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9637e746-24f8-4cb7-bac6-e839a7e22bf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:01:42.051306 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9637e746-24f8-4cb7-bac6-e839a7e22bf2 None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:01:42.051689 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9637e746-24f8-4cb7-bac6-e839a7e22bf2 None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:01:42.052059 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9637e746-24f8-4cb7-bac6-e839a7e22bf2 None admin] PATH_INFO: `/v3/domains` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:01:42.052812 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9637e746-24f8-4cb7-bac6-e839a7e22bf2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81765) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:01:42.053416 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9637e746-24f8-4cb7-bac6-e839a7e22bf2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:01:42.055477 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9637e746-24f8-4cb7-bac6-e839a7e22bf2 None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:01:42.081156 dv-cinder-862365-1-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 280/572] 10.222.0.23 () {56 vars in 1109 bytes} [Fri Oct 28 19:01:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 319 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:01:42.090882 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9637e746-24f8-4cb7-bac6-e839a7e22bf2 None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:01:42.123339 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:01:42.149764 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a38ce9-1f8f-4b29-a38e-c9f53b2bbaf2 None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:01:42.191053 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1dc173b-8def-4282-9b90-c9bda6518479 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:01:42.191917 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1dc173b-8def-4282-9b90-c9bda6518479 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:01:42.192304 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1dc173b-8def-4282-9b90-c9bda6518479 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:01:42.192679 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1dc173b-8def-4282-9b90-c9bda6518479 None admin] PATH_INFO: `/v3/projects` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:01:42.193630 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1dc173b-8def-4282-9b90-c9bda6518479 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:01:42.194061 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1dc173b-8def-4282-9b90-c9bda6518479 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:01:42.195672 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1dc173b-8def-4282-9b90-c9bda6518479 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:01:42.211114 dv-cinder-862365-1-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 293/573] 10.222.0.23 () {56 vars in 1148 bytes} [Fri Oct 28 19:01:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:01:42.212201 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1dc173b-8def-4282-9b90-c9bda6518479 None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:01:42.225679 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9637e746-24f8-4cb7-bac6-e839a7e22bf2 None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:01:42.262734 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba3233d-4d57-49e3-a653-24ae227c09bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:01:42.263379 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba3233d-4d57-49e3-a653-24ae227c09bd None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:01:42.263768 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba3233d-4d57-49e3-a653-24ae227c09bd None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:01:42.264052 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba3233d-4d57-49e3-a653-24ae227c09bd None admin] PATH_INFO: `/v3/projects/service` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:01:42.271487 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba3233d-4d57-49e3-a653-24ae227c09bd None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:01:42.273113 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba3233d-4d57-49e3-a653-24ae227c09bd None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:01:42.286495 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application [None req-1ba3233d-4d57-49e3-a653-24ae227c09bd None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 28 19:01:42.286495 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 19:01:42.286495 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 19:01:42.286495 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 19:01:42.286495 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 19:01:42.286495 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 19:01:42.286495 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 19:01:42.286495 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 19:01:42.286495 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 19:01:42.286495 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 19:01:42.286495 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 19:01:42.286495 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 19:01:42.286495 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 28 19:01:42.286495 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 28 19:01:42.286495 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 28 19:01:42.287451 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 28 19:01:42.287451 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 19:01:42.287451 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 19:01:42.287451 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 19:01:42.287451 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 19:01:42.287451 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 19:01:42.287451 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 19:01:42.287451 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 19:01:42.287451 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application with Lock( Oct 28 19:01:42.287451 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 19:01:42.287451 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._enter() Oct 28 19:01:42.287451 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 19:01:42.287451 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 19:01:42.287451 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 19:01:42.287451 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.creator() Oct 28 19:01:42.287451 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 19:01:42.287451 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application created_value = creator( Oct 28 19:01:42.288355 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 28 19:01:42.288355 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 28 19:01:42.288355 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 28 19:01:42.288355 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 28 19:01:42.288355 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 28 19:01:42.288355 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 28 19:01:42.288355 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 28 19:01:42.288355 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application Oct 28 19:01:42.288355 dv-cinder-862365-1-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 281/574] 10.222.0.23 () {56 vars in 1111 bytes} [Fri Oct 28 19:01:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 19:01:42.289635 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba3233d-4d57-49e3-a653-24ae227c09bd None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:01:42.312394 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:01:42.325326 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1dc173b-8def-4282-9b90-c9bda6518479 None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:01:42.360375 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd736b55-061c-4be9-80a1-093ac17cfd2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:01:42.361002 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd736b55-061c-4be9-80a1-093ac17cfd2a None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:01:42.361283 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd736b55-061c-4be9-80a1-093ac17cfd2a None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:01:42.361585 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd736b55-061c-4be9-80a1-093ac17cfd2a None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:01:42.362168 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd736b55-061c-4be9-80a1-093ac17cfd2a None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:01:42.363525 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd736b55-061c-4be9-80a1-093ac17cfd2a None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:01:42.365274 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:01:42.374543 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application [None req-dd736b55-061c-4be9-80a1-093ac17cfd2a None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 28 19:01:42.374543 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 19:01:42.374543 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 28 19:01:42.374543 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 28 19:01:42.374543 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 28 19:01:42.374543 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 28 19:01:42.374543 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 28 19:01:42.374543 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 28 19:01:42.374543 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 28 19:01:42.374543 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Oct 28 19:01:42.374543 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 28 19:01:42.374543 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Oct 28 19:01:42.374543 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 19:01:42.374543 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 19:01:42.374543 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 19:01:42.374543 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 19:01:42.374543 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 19:01:42.375518 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 19:01:42.375518 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 19:01:42.375518 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 19:01:42.375518 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 19:01:42.375518 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 19:01:42.375518 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 19:01:42.375518 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 28 19:01:42.375518 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 28 19:01:42.375518 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 28 19:01:42.375518 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 28 19:01:42.375518 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 19:01:42.375518 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 19:01:42.375518 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 19:01:42.375518 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 19:01:42.375518 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 19:01:42.375518 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 19:01:42.376442 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 19:01:42.376442 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application with Lock( Oct 28 19:01:42.376442 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 19:01:42.376442 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._enter() Oct 28 19:01:42.376442 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 19:01:42.376442 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 19:01:42.376442 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 19:01:42.376442 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.creator() Oct 28 19:01:42.376442 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 19:01:42.376442 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application created_value = creator( Oct 28 19:01:42.376442 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 28 19:01:42.376442 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 28 19:01:42.376442 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 28 19:01:42.376442 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Oct 28 19:01:42.376442 dv-cinder-862365-1-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 294/575] 10.222.0.23 () {56 vars in 1129 bytes} [Fri Oct 28 19:01:42 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 19:01:42.382297 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea20fca-022e-4ecd-8277-c86479cdf48f None None] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:01:42.382586 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea20fca-022e-4ecd-8277-c86479cdf48f None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:01:42.382865 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea20fca-022e-4ecd-8277-c86479cdf48f None None] PATH_INFO: `/` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:01:42.384133 dv-cinder-862365-1-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 295/576] 10.222.0.23 () {54 vars in 927 bytes} [Fri Oct 28 19:01:42 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 19:01:42.385404 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea20fca-022e-4ecd-8277-c86479cdf48f None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:01:42.403391 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba3233d-4d57-49e3-a653-24ae227c09bd None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:01:42.439843 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b969b97-3962-4c41-ba65-7fab3754fab4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:01:42.440532 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b969b97-3962-4c41-ba65-7fab3754fab4 None admin] REQUEST_METHOD: `PUT` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:01:42.440822 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b969b97-3962-4c41-ba65-7fab3754fab4 None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:01:42.441099 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b969b97-3962-4c41-ba65-7fab3754fab4 None admin] PATH_INFO: `/v3/projects/b705897907f042c0818a931052438e1e/users/820bee57d7dc4c5a962107e97f050835/roles/068b73485c0e46cb8a8d88b948028746` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:01:42.458519 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b969b97-3962-4c41-ba65-7fab3754fab4 None admin] RBAC: Authorizing `identity:create_grant(project_id=b705897907f042c0818a931052438e1e, user_id=820bee57d7dc4c5a962107e97f050835, role_id=068b73485c0e46cb8a8d88b948028746)` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:01:42.459971 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b969b97-3962-4c41-ba65-7fab3754fab4 None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:01:42.494850 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea20fca-022e-4ecd-8277-c86479cdf48f None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:01:42.528525 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c926ba4b-48e4-474a-aeb0-f16d053ebb39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:01:42.529117 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c926ba4b-48e4-474a-aeb0-f16d053ebb39 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:01:42.529428 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c926ba4b-48e4-474a-aeb0-f16d053ebb39 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:01:42.529706 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c926ba4b-48e4-474a-aeb0-f16d053ebb39 None admin] PATH_INFO: `/v3/projects` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:01:42.530382 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c926ba4b-48e4-474a-aeb0-f16d053ebb39 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:01:42.530689 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c926ba4b-48e4-474a-aeb0-f16d053ebb39 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:01:42.532147 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c926ba4b-48e4-474a-aeb0-f16d053ebb39 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:01:42.543590 dv-cinder-862365-1-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 296/577] 10.222.0.23 () {56 vars in 1148 bytes} [Fri Oct 28 19:01:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:01:42.544355 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c926ba4b-48e4-474a-aeb0-f16d053ebb39 None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:01:42.557213 dv-cinder-862365-1-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 282/578] 10.222.0.23 () {58 vars in 1439 bytes} [Fri Oct 28 19:01:42 2022] PUT /identity/v3/projects/b705897907f042c0818a931052438e1e/users/820bee57d7dc4c5a962107e97f050835/roles/068b73485c0e46cb8a8d88b948028746 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 19:01:42.559284 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294bd757-16d5-4999-be5a-dff524766003 None None] REQUEST_METHOD: `POST` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:01:42.559714 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294bd757-16d5-4999-be5a-dff524766003 None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:01:42.560594 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294bd757-16d5-4999-be5a-dff524766003 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:01:42.585145 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.auth.core [None req-294bd757-16d5-4999-be5a-dff524766003 None None] MFA Rules not processed for user `ae863915635746d1ac19970949de4722`. Rule list: `[]` (Enabled: `True`). {{(pid=81765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:01:42.587963 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-294bd757-16d5-4999-be5a-dff524766003 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:01:42.618296 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:01:42.665096 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c926ba4b-48e4-474a-aeb0-f16d053ebb39 None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:01:42.682188 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:01:42.684422 dv-cinder-862365-1-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 283/579] 10.222.0.23 () {58 vars in 1024 bytes} [Fri Oct 28 19:01:42 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 28 19:01:42.690250 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294bd757-16d5-4999-be5a-dff524766003 None None] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:01:42.756052 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec618960-ae26-46ec-84ed-dfbe922ed297 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:01:42.756733 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec618960-ae26-46ec-84ed-dfbe922ed297 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:01:42.757026 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec618960-ae26-46ec-84ed-dfbe922ed297 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:01:42.757206 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec618960-ae26-46ec-84ed-dfbe922ed297 None admin] PATH_INFO: `/v3/services` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:01:42.757867 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec618960-ae26-46ec-84ed-dfbe922ed297 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:01:42.758168 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec618960-ae26-46ec-84ed-dfbe922ed297 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:01:42.759540 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec618960-ae26-46ec-84ed-dfbe922ed297 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:01:42.769446 dv-cinder-862365-1-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 297/580] 10.222.0.23 () {56 vars in 1124 bytes} [Fri Oct 28 19:01:42 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:01:42.773316 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec618960-ae26-46ec-84ed-dfbe922ed297 None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:01:42.836573 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294bd757-16d5-4999-be5a-dff524766003 None None] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:01:42.945301 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78443010-1803-4b1e-94db-96a2bde860d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:01:42.946278 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78443010-1803-4b1e-94db-96a2bde860d8 None admin] REQUEST_METHOD: `PUT` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:01:42.946771 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78443010-1803-4b1e-94db-96a2bde860d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:01:42.947227 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78443010-1803-4b1e-94db-96a2bde860d8 None admin] PATH_INFO: `/v3/projects/b705897907f042c0818a931052438e1e/users/ddd2863f2113472cb20577990b5c55d7/roles/a9e4e47c2bf448fcbada91c1174644f7` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:01:42.951799 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78443010-1803-4b1e-94db-96a2bde860d8 None admin] RBAC: Authorizing `identity:create_grant(project_id=b705897907f042c0818a931052438e1e, user_id=ddd2863f2113472cb20577990b5c55d7, role_id=a9e4e47c2bf448fcbada91c1174644f7)` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:01:42.953456 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78443010-1803-4b1e-94db-96a2bde860d8 None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:01:42.982254 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec618960-ae26-46ec-84ed-dfbe922ed297 None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:01:43.006848 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:01:43.019240 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c06bf46-5ed3-445d-989b-773569643fae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:01:43.020109 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c06bf46-5ed3-445d-989b-773569643fae None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:01:43.020665 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c06bf46-5ed3-445d-989b-773569643fae None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:01:43.021165 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c06bf46-5ed3-445d-989b-773569643fae None admin] PATH_INFO: `/v3/services` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:01:43.022010 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c06bf46-5ed3-445d-989b-773569643fae None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:01:43.022500 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c06bf46-5ed3-445d-989b-773569643fae None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:01:43.024029 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c06bf46-5ed3-445d-989b-773569643fae None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:01:43.030558 dv-cinder-862365-1-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 298/581] 10.222.0.23 () {56 vars in 1124 bytes} [Fri Oct 28 19:01:42 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:01:43.031522 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c06bf46-5ed3-445d-989b-773569643fae None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:01:43.044976 dv-cinder-862365-1-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 284/582] 10.222.0.23 () {58 vars in 1439 bytes} [Fri Oct 28 19:01:42 2022] PUT /identity/v3/projects/b705897907f042c0818a931052438e1e/users/ddd2863f2113472cb20577990b5c55d7/roles/a9e4e47c2bf448fcbada91c1174644f7 => generated 0 bytes in 360 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 19:01:43.053237 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78443010-1803-4b1e-94db-96a2bde860d8 None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:01:43.179488 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:01:43.181275 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c06bf46-5ed3-445d-989b-773569643fae None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:01:43.226259 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a6b597-4573-42bc-941f-dfad5eb3a036 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:01:43.227239 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a6b597-4573-42bc-941f-dfad5eb3a036 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:01:43.228292 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a6b597-4573-42bc-941f-dfad5eb3a036 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:01:43.228897 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a6b597-4573-42bc-941f-dfad5eb3a036 None admin] PATH_INFO: `/v3/services/network` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:01:43.230078 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a6b597-4573-42bc-941f-dfad5eb3a036 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:01:43.231835 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a6b597-4573-42bc-941f-dfad5eb3a036 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:01:43.243324 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application [None req-a9a6b597-4573-42bc-941f-dfad5eb3a036 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Oct 28 19:01:43.243324 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 19:01:43.243324 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 28 19:01:43.243324 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 28 19:01:43.243324 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 28 19:01:43.243324 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 28 19:01:43.243324 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 28 19:01:43.243324 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 28 19:01:43.243324 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Oct 28 19:01:43.243324 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Oct 28 19:01:43.243324 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 28 19:01:43.243324 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Oct 28 19:01:43.243324 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 19:01:43.243324 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 19:01:43.243324 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 19:01:43.243324 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 19:01:43.243324 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 19:01:43.245245 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 19:01:43.245245 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 19:01:43.245245 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 19:01:43.245245 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 19:01:43.245245 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 19:01:43.245245 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 19:01:43.245245 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 28 19:01:43.245245 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 28 19:01:43.245245 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 28 19:01:43.245245 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 28 19:01:43.245245 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 19:01:43.245245 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 19:01:43.245245 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 19:01:43.245245 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 19:01:43.245245 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 19:01:43.245245 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 19:01:43.246380 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 19:01:43.246380 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application with Lock( Oct 28 19:01:43.246380 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 19:01:43.246380 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._enter() Oct 28 19:01:43.246380 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 19:01:43.246380 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 19:01:43.246380 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 19:01:43.246380 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.creator() Oct 28 19:01:43.246380 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 19:01:43.246380 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application created_value = creator( Oct 28 19:01:43.246380 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 28 19:01:43.246380 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 28 19:01:43.246380 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Oct 28 19:01:43.246380 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Oct 28 19:01:43.254209 dv-cinder-862365-1-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 299/583] 10.222.0.23 () {56 vars in 1111 bytes} [Fri Oct 28 19:01:43 2022] GET /identity/v3/services/network => generated 88 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 19:01:43.257040 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a6b597-4573-42bc-941f-dfad5eb3a036 None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:01:43.288616 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78443010-1803-4b1e-94db-96a2bde860d8 None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:01:43.324355 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:01:43.334882 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76397f2-9263-4917-aa6f-cfbf529349a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:01:43.335663 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76397f2-9263-4917-aa6f-cfbf529349a3 None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:01:43.335949 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76397f2-9263-4917-aa6f-cfbf529349a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:01:43.336485 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76397f2-9263-4917-aa6f-cfbf529349a3 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:01:43.337196 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76397f2-9263-4917-aa6f-cfbf529349a3 None admin] RBAC: Adding query filter params (interface=public, service_id=bf48dc6d179340dd9644d534323a3998, region_id=RegionOne) {{(pid=81765) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:01:43.337601 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76397f2-9263-4917-aa6f-cfbf529349a3 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:01:43.338963 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76397f2-9263-4917-aa6f-cfbf529349a3 None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:01:43.347627 dv-cinder-862365-1-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 285/584] 10.222.0.23 () {56 vars in 1251 bytes} [Fri Oct 28 19:01:43 2022] GET /identity/v3/endpoints?service_id=bf48dc6d179340dd9644d534323a3998&interface=public®ion_id=RegionOne => generated 194 bytes in 302 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:01:43.353715 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76397f2-9263-4917-aa6f-cfbf529349a3 None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:01:43.387759 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a6b597-4573-42bc-941f-dfad5eb3a036 None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:01:43.430319 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92f8e0d-c97b-4bc0-a885-c550c553a258 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:01:43.431279 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92f8e0d-c97b-4bc0-a885-c550c553a258 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:01:43.432235 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92f8e0d-c97b-4bc0-a885-c550c553a258 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:01:43.432747 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92f8e0d-c97b-4bc0-a885-c550c553a258 None admin] PATH_INFO: `/v3/services` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:01:43.433538 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f92f8e0d-c97b-4bc0-a885-c550c553a258 None admin] RBAC: Adding query filter params (name=network) {{(pid=81766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:01:43.433982 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f92f8e0d-c97b-4bc0-a885-c550c553a258 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:01:43.435825 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f92f8e0d-c97b-4bc0-a885-c550c553a258 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:01:43.450914 dv-cinder-862365-1-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 300/585] 10.222.0.23 () {56 vars in 1112 bytes} [Fri Oct 28 19:01:43 2022] GET /identity/v3/services?name=network => generated 124 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 19:01:43.456684 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92f8e0d-c97b-4bc0-a885-c550c553a258 None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:01:43.514716 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76397f2-9263-4917-aa6f-cfbf529349a3 None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:01:43.545736 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:01:43.571002 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6181c285-7dc6-4174-800d-9a04d4c70e66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:01:43.571771 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6181c285-7dc6-4174-800d-9a04d4c70e66 None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:01:43.572199 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6181c285-7dc6-4174-800d-9a04d4c70e66 None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:01:43.572600 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6181c285-7dc6-4174-800d-9a04d4c70e66 None admin] PATH_INFO: `/v3/services` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:01:43.573417 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6181c285-7dc6-4174-800d-9a04d4c70e66 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:01:43.576458 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6181c285-7dc6-4174-800d-9a04d4c70e66 None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:01:43.585558 dv-cinder-862365-1-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 286/586] 10.222.0.23 () {56 vars in 1087 bytes} [Fri Oct 28 19:01:43 2022] GET /identity/v3/services => generated 772 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 19:01:43.621843 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92f8e0d-c97b-4bc0-a885-c550c553a258 None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:01:43.644862 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:01:43.675538 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a20c7c6-cd39-405d-9ff6-50b334507f55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:01:43.676149 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a20c7c6-cd39-405d-9ff6-50b334507f55 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:01:43.676430 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a20c7c6-cd39-405d-9ff6-50b334507f55 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:01:43.676802 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a20c7c6-cd39-405d-9ff6-50b334507f55 None admin] PATH_INFO: `/v3/services` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:01:43.677453 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a20c7c6-cd39-405d-9ff6-50b334507f55 None admin] RBAC: Adding query filter params (type=network) {{(pid=81766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:01:43.677758 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a20c7c6-cd39-405d-9ff6-50b334507f55 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:01:43.679141 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a20c7c6-cd39-405d-9ff6-50b334507f55 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:01:43.688583 dv-cinder-862365-1-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 301/587] 10.222.0.23 () {56 vars in 1112 bytes} [Fri Oct 28 19:01:43 2022] GET /identity/v3/services?type=network => generated 350 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:01:43.695194 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6181c285-7dc6-4174-800d-9a04d4c70e66 None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:01:43.839293 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6181c285-7dc6-4174-800d-9a04d4c70e66 None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:01:43.855257 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1966abd-5f4c-4ccf-b43d-3e0a93b4e680 None None] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:01:43.855800 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1966abd-5f4c-4ccf-b43d-3e0a93b4e680 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:01:43.855800 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1966abd-5f4c-4ccf-b43d-3e0a93b4e680 None None] PATH_INFO: `/` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:01:43.857114 dv-cinder-862365-1-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 302/588] 10.222.0.23 () {54 vars in 927 bytes} [Fri Oct 28 19:01:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 19:01:43.866545 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdee5c7-0a91-4513-8f07-c6af6ea58e79 None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:01:43.866824 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdee5c7-0a91-4513-8f07-c6af6ea58e79 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:01:43.867097 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdee5c7-0a91-4513-8f07-c6af6ea58e79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:01:43.878895 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36be0455-3881-4938-abdd-e2db75d14c29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:01:43.879700 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36be0455-3881-4938-abdd-e2db75d14c29 None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:01:43.879984 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36be0455-3881-4938-abdd-e2db75d14c29 None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:01:43.880326 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36be0455-3881-4938-abdd-e2db75d14c29 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:01:43.881022 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36be0455-3881-4938-abdd-e2db75d14c29 None admin] RBAC: Adding query filter params (interface=public, service_id=a38d4b4f969b4486b932d3f13c4f96a7, region_id=RegionOne) {{(pid=81765) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:01:43.881374 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36be0455-3881-4938-abdd-e2db75d14c29 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:01:43.882764 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36be0455-3881-4938-abdd-e2db75d14c29 None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:01:43.888711 dv-cinder-862365-1-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 287/589] 10.222.0.23 () {56 vars in 1251 bytes} [Fri Oct 28 19:01:43 2022] GET /identity/v3/endpoints?service_id=a38d4b4f969b4486b932d3f13c4f96a7&interface=public®ion_id=RegionOne => generated 194 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:01:43.894245 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36be0455-3881-4938-abdd-e2db75d14c29 None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:01:43.910552 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-2cdee5c7-0a91-4513-8f07-c6af6ea58e79 None None] MFA Rules not processed for user `ae863915635746d1ac19970949de4722`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:01:43.912069 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-2cdee5c7-0a91-4513-8f07-c6af6ea58e79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:01:43.959637 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:01:44.000518 dv-cinder-862365-1-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 303/590] 10.222.0.23 () {58 vars in 1024 bytes} [Fri Oct 28 19:01:43 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 28 19:01:44.018700 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36be0455-3881-4938-abdd-e2db75d14c29 None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:01:44.053284 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47055b19-af4c-4f5d-b27b-3aed7b3bcaf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:01:44.053925 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47055b19-af4c-4f5d-b27b-3aed7b3bcaf7 None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:01:44.054207 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47055b19-af4c-4f5d-b27b-3aed7b3bcaf7 None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:01:44.054483 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47055b19-af4c-4f5d-b27b-3aed7b3bcaf7 None admin] PATH_INFO: `/v3/services` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:01:44.055086 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47055b19-af4c-4f5d-b27b-3aed7b3bcaf7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:01:44.056456 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47055b19-af4c-4f5d-b27b-3aed7b3bcaf7 None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:01:44.062574 dv-cinder-862365-1-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 288/591] 10.222.0.23 () {56 vars in 1087 bytes} [Fri Oct 28 19:01:43 2022] GET /identity/v3/services => generated 772 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 19:01:44.287468 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cdee5c7-0a91-4513-8f07-c6af6ea58e79 None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:01:44.412185 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cdee5c7-0a91-4513-8f07-c6af6ea58e79 None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:01:44.422763 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:01:44.452493 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624bca4c-14fe-4cc4-8d82-8f2ec2300684 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:01:44.453132 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624bca4c-14fe-4cc4-8d82-8f2ec2300684 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:01:44.453472 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624bca4c-14fe-4cc4-8d82-8f2ec2300684 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:01:44.453712 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624bca4c-14fe-4cc4-8d82-8f2ec2300684 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:01:44.454300 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624bca4c-14fe-4cc4-8d82-8f2ec2300684 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:01:44.455670 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624bca4c-14fe-4cc4-8d82-8f2ec2300684 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:01:44.470832 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application [None req-624bca4c-14fe-4cc4-8d82-8f2ec2300684 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 28 19:01:44.470832 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 19:01:44.470832 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 28 19:01:44.470832 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 28 19:01:44.470832 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 28 19:01:44.470832 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 28 19:01:44.470832 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 28 19:01:44.470832 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 28 19:01:44.470832 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 28 19:01:44.470832 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Oct 28 19:01:44.470832 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 28 19:01:44.470832 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Oct 28 19:01:44.470832 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 19:01:44.470832 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 19:01:44.470832 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 19:01:44.470832 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 19:01:44.471796 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 19:01:44.471796 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 19:01:44.471796 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 19:01:44.471796 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 19:01:44.471796 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 19:01:44.471796 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 19:01:44.471796 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 19:01:44.471796 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 28 19:01:44.471796 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 28 19:01:44.471796 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 28 19:01:44.471796 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 28 19:01:44.471796 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 19:01:44.471796 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 19:01:44.471796 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 19:01:44.471796 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 19:01:44.471796 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 19:01:44.471796 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 19:01:44.472668 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 19:01:44.472668 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application with Lock( Oct 28 19:01:44.472668 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 19:01:44.472668 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._enter() Oct 28 19:01:44.472668 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 19:01:44.472668 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 19:01:44.472668 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 19:01:44.472668 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.creator() Oct 28 19:01:44.472668 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 19:01:44.472668 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application created_value = creator( Oct 28 19:01:44.472668 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 28 19:01:44.472668 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 28 19:01:44.472668 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 28 19:01:44.472668 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Oct 28 19:01:44.472668 dv-cinder-862365-1-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 304/592] 10.222.0.23 () {56 vars in 1132 bytes} [Fri Oct 28 19:01:44 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 19:01:44.479768 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47055b19-af4c-4f5d-b27b-3aed7b3bcaf7 None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:01:44.610099 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47055b19-af4c-4f5d-b27b-3aed7b3bcaf7 None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:01:44.630416 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:01:44.655483 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e57bd5b-e307-42f8-81c2-e8af7538bb3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:01:44.656112 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e57bd5b-e307-42f8-81c2-e8af7538bb3f None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:01:44.656398 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e57bd5b-e307-42f8-81c2-e8af7538bb3f None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:01:44.656677 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e57bd5b-e307-42f8-81c2-e8af7538bb3f None admin] PATH_INFO: `/v3/services` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:01:44.657315 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e57bd5b-e307-42f8-81c2-e8af7538bb3f None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81765) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:01:44.657651 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e57bd5b-e307-42f8-81c2-e8af7538bb3f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:01:44.659121 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e57bd5b-e307-42f8-81c2-e8af7538bb3f None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:01:44.664411 dv-cinder-862365-1-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 289/593] 10.222.0.23 () {56 vars in 1126 bytes} [Fri Oct 28 19:01:44 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:01:44.669980 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624bca4c-14fe-4cc4-8d82-8f2ec2300684 None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:01:44.814066 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624bca4c-14fe-4cc4-8d82-8f2ec2300684 None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:01:44.867182 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9befd3c-ce16-45ff-814b-ccad8638369e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:01:44.867182 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9befd3c-ce16-45ff-814b-ccad8638369e None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:01:44.867182 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9befd3c-ce16-45ff-814b-ccad8638369e None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:01:44.867182 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9befd3c-ce16-45ff-814b-ccad8638369e None admin] PATH_INFO: `/v3/services` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:01:44.867950 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9befd3c-ce16-45ff-814b-ccad8638369e None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:01:44.867950 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9befd3c-ce16-45ff-814b-ccad8638369e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:01:44.867950 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9befd3c-ce16-45ff-814b-ccad8638369e None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:01:44.872443 dv-cinder-862365-1-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 305/594] 10.222.0.23 () {56 vars in 1126 bytes} [Fri Oct 28 19:01:44 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:01:45.236823 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db28873-d4f8-4d85-9af6-56e3dd7aee5a None None] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:01:45.237330 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db28873-d4f8-4d85-9af6-56e3dd7aee5a None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:01:45.237330 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db28873-d4f8-4d85-9af6-56e3dd7aee5a None None] PATH_INFO: `/` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:01:45.238949 dv-cinder-862365-1-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 290/595] 10.222.0.23 () {54 vars in 927 bytes} [Fri Oct 28 19:01:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 19:01:45.244921 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7115b9-fee4-46c6-9539-135bb924007d None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:01:45.245214 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7115b9-fee4-46c6-9539-135bb924007d None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:01:45.245573 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7115b9-fee4-46c6-9539-135bb924007d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:01:45.264552 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-5c7115b9-fee4-46c6-9539-135bb924007d None None] MFA Rules not processed for user `ae863915635746d1ac19970949de4722`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:01:45.267211 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-5c7115b9-fee4-46c6-9539-135bb924007d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:01:45.302573 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:01:45.359580 dv-cinder-862365-1-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 306/596] 10.222.0.23 () {58 vars in 1024 bytes} [Fri Oct 28 19:01:45 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 28 19:01:45.740654 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db28873-d4f8-4d85-9af6-56e3dd7aee5a None None] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:01:45.809155 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c4efc4-048b-439f-a9e2-11d094f7a390 None None] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:01:45.809512 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c4efc4-048b-439f-a9e2-11d094f7a390 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:01:45.810128 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c4efc4-048b-439f-a9e2-11d094f7a390 None None] PATH_INFO: `/` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:01:45.812142 dv-cinder-862365-1-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 307/597] 10.222.0.23 () {54 vars in 927 bytes} [Fri Oct 28 19:01:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 19:01:45.817721 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0626a0a2-75e0-4c18-9ace-4c9b12972d80 None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:01:45.818013 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0626a0a2-75e0-4c18-9ace-4c9b12972d80 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:01:45.818293 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0626a0a2-75e0-4c18-9ace-4c9b12972d80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:01:45.839885 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-0626a0a2-75e0-4c18-9ace-4c9b12972d80 None None] MFA Rules not processed for user `ae863915635746d1ac19970949de4722`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:01:45.843529 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-0626a0a2-75e0-4c18-9ace-4c9b12972d80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:01:45.895021 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db28873-d4f8-4d85-9af6-56e3dd7aee5a None None] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:01:45.931451 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4f761e-f240-4706-b103-72ce7f39efcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:01:45.932119 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4f761e-f240-4706-b103-72ce7f39efcc None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:01:45.932402 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4f761e-f240-4706-b103-72ce7f39efcc None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:01:45.932734 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4f761e-f240-4706-b103-72ce7f39efcc None admin] PATH_INFO: `/v3/roles/service` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:01:45.943766 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e4f761e-f240-4706-b103-72ce7f39efcc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 19:01:45.949870 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application [None req-8e4f761e-f240-4706-b103-72ce7f39efcc None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 28 19:01:45.949870 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 19:01:45.949870 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 19:01:45.949870 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 19:01:45.949870 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 19:01:45.949870 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 19:01:45.949870 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 19:01:45.949870 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 19:01:45.949870 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 19:01:45.949870 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 19:01:45.949870 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 19:01:45.949870 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 19:01:45.949870 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 28 19:01:45.949870 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 28 19:01:45.949870 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 28 19:01:45.949870 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 28 19:01:45.951514 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 28 19:01:45.951514 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 28 19:01:45.951514 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 28 19:01:45.951514 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 28 19:01:45.951514 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 19:01:45.951514 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 19:01:45.951514 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 19:01:45.951514 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 19:01:45.951514 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 19:01:45.951514 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 19:01:45.951514 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 19:01:45.951514 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application with Lock( Oct 28 19:01:45.951514 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 19:01:45.951514 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._enter() Oct 28 19:01:45.951514 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 19:01:45.951514 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 19:01:45.952878 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 19:01:45.952878 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.creator() Oct 28 19:01:45.952878 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 19:01:45.952878 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application created_value = creator( Oct 28 19:01:45.952878 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 28 19:01:45.952878 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 28 19:01:45.952878 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 28 19:01:45.952878 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 28 19:01:45.952878 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 28 19:01:45.952878 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 28 19:01:45.952878 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 28 19:01:45.952878 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application Oct 28 19:01:45.954902 dv-cinder-862365-1-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 291/598] 10.222.0.23 () {56 vars in 1102 bytes} [Fri Oct 28 19:01:45 2022] GET /identity/v3/roles/service => generated 85 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 19:01:45.963660 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4f761e-f240-4706-b103-72ce7f39efcc None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:01:45.984033 dv-cinder-862365-1-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 308/599] 10.222.0.23 () {58 vars in 1024 bytes} [Fri Oct 28 19:01:45 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 28 19:01:46.049780 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:01:46.095094 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4f761e-f240-4706-b103-72ce7f39efcc None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:01:46.129907 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64003c9b-a34a-457c-9eba-3daf17b1a077 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:01:46.131878 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64003c9b-a34a-457c-9eba-3daf17b1a077 None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:01:46.132161 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64003c9b-a34a-457c-9eba-3daf17b1a077 None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:01:46.132438 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64003c9b-a34a-457c-9eba-3daf17b1a077 None admin] PATH_INFO: `/v3/roles` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:01:46.133171 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64003c9b-a34a-457c-9eba-3daf17b1a077 None admin] RBAC: Adding query filter params (name=service) {{(pid=81765) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:01:46.133507 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64003c9b-a34a-457c-9eba-3daf17b1a077 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:01:46.135414 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64003c9b-a34a-457c-9eba-3daf17b1a077 None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:01:46.144034 dv-cinder-862365-1-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 292/600] 10.222.0.23 () {56 vars in 1103 bytes} [Fri Oct 28 19:01:45 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:01:46.149719 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0626a0a2-75e0-4c18-9ace-4c9b12972d80 None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:01:46.290688 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:01:46.297274 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0626a0a2-75e0-4c18-9ace-4c9b12972d80 None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:01:46.344071 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60b7e8f-8885-4814-9519-2bb8ae31e47b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:01:46.344714 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60b7e8f-8885-4814-9519-2bb8ae31e47b None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:01:46.344994 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60b7e8f-8885-4814-9519-2bb8ae31e47b None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:01:46.345258 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60b7e8f-8885-4814-9519-2bb8ae31e47b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:01:46.345898 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64003c9b-a34a-457c-9eba-3daf17b1a077 None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:01:46.356658 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c60b7e8f-8885-4814-9519-2bb8ae31e47b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:01:46.358307 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c60b7e8f-8885-4814-9519-2bb8ae31e47b None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:01:46.380205 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application [None req-c60b7e8f-8885-4814-9519-2bb8ae31e47b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 19:01:46.380205 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 19:01:46.380205 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 19:01:46.380205 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 19:01:46.380205 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 19:01:46.380205 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 19:01:46.380205 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 19:01:46.380205 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 19:01:46.380205 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 19:01:46.380205 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 19:01:46.380205 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 19:01:46.380205 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 19:01:46.380205 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 28 19:01:46.380205 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 28 19:01:46.380205 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 28 19:01:46.380205 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 28 19:01:46.382542 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 19:01:46.382542 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 19:01:46.382542 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 19:01:46.382542 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 19:01:46.382542 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 19:01:46.382542 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 19:01:46.382542 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 19:01:46.382542 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application with Lock( Oct 28 19:01:46.382542 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 19:01:46.382542 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._enter() Oct 28 19:01:46.382542 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 19:01:46.382542 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 19:01:46.382542 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 19:01:46.382542 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.creator() Oct 28 19:01:46.382542 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 19:01:46.382542 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application created_value = creator( Oct 28 19:01:46.382542 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 28 19:01:46.384718 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 28 19:01:46.384718 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 19:01:46.384718 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Oct 28 19:01:46.384718 dv-cinder-862365-1-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 309/601] 10.222.0.23 () {56 vars in 1108 bytes} [Fri Oct 28 19:01:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 19:01:46.395595 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60b7e8f-8885-4814-9519-2bb8ae31e47b None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:01:46.515986 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60b7e8f-8885-4814-9519-2bb8ae31e47b None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:01:46.557684 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7972d96-331f-4636-9bd3-925f11984a33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:01:46.558309 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7972d96-331f-4636-9bd3-925f11984a33 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:01:46.558635 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7972d96-331f-4636-9bd3-925f11984a33 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:01:46.558914 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7972d96-331f-4636-9bd3-925f11984a33 None admin] PATH_INFO: `/v3/domains` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:01:46.559539 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64003c9b-a34a-457c-9eba-3daf17b1a077 None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:01:46.559726 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7972d96-331f-4636-9bd3-925f11984a33 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:01:46.559883 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7972d96-331f-4636-9bd3-925f11984a33 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:01:46.561204 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:01:46.562253 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7972d96-331f-4636-9bd3-925f11984a33 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:01:46.577580 dv-cinder-862365-1-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 310/602] 10.222.0.23 () {56 vars in 1109 bytes} [Fri Oct 28 19:01:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:01:46.582477 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7972d96-331f-4636-9bd3-925f11984a33 None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:01:46.595124 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:01:46.668676 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa6b0aa-2c4f-457b-aa44-d1718225214e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:01:46.669328 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa6b0aa-2c4f-457b-aa44-d1718225214e None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:01:46.669635 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa6b0aa-2c4f-457b-aa44-d1718225214e None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:01:46.669912 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa6b0aa-2c4f-457b-aa44-d1718225214e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:01:46.697795 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa6b0aa-2c4f-457b-aa44-d1718225214e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 19:01:46.703645 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application [None req-6fa6b0aa-2c4f-457b-aa44-d1718225214e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 28 19:01:46.703645 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 19:01:46.703645 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 19:01:46.703645 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 19:01:46.703645 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 19:01:46.703645 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 19:01:46.703645 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 19:01:46.703645 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 19:01:46.703645 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 19:01:46.703645 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 19:01:46.703645 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 19:01:46.703645 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 19:01:46.703645 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 28 19:01:46.703645 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 28 19:01:46.703645 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 28 19:01:46.703645 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 28 19:01:46.706000 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 28 19:01:46.706000 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 28 19:01:46.706000 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 28 19:01:46.706000 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 28 19:01:46.706000 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 19:01:46.706000 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 19:01:46.706000 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 19:01:46.706000 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 19:01:46.706000 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 19:01:46.706000 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 19:01:46.706000 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 19:01:46.706000 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application with Lock( Oct 28 19:01:46.706000 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 19:01:46.706000 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._enter() Oct 28 19:01:46.706000 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 19:01:46.706000 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 19:01:46.708081 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 19:01:46.708081 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.creator() Oct 28 19:01:46.708081 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 19:01:46.708081 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application created_value = creator( Oct 28 19:01:46.708081 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 28 19:01:46.708081 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 28 19:01:46.708081 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 28 19:01:46.708081 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 28 19:01:46.708081 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 28 19:01:46.708081 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 28 19:01:46.708081 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 28 19:01:46.708081 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application Oct 28 19:01:46.709959 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7972d96-331f-4636-9bd3-925f11984a33 None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:01:46.710128 dv-cinder-862365-1-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 293/603] 10.222.0.23 () {56 vars in 1096 bytes} [Fri Oct 28 19:01:46 2022] GET /identity/v3/roles/admin => generated 83 bytes in 360 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 19:01:46.710128 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f8a0d7-8427-4d6f-a797-aeadd685227c None None] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:01:46.710128 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f8a0d7-8427-4d6f-a797-aeadd685227c None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:01:46.710128 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f8a0d7-8427-4d6f-a797-aeadd685227c None None] PATH_INFO: `/` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:01:46.717630 dv-cinder-862365-1-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 294/604] 10.222.0.23 () {54 vars in 927 bytes} [Fri Oct 28 19:01:46 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 19:01:46.717630 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f8a0d7-8427-4d6f-a797-aeadd685227c None None] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:01:46.749576 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db5cd35-46a0-4542-a8d5-5bc43461e2ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:01:46.750463 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db5cd35-46a0-4542-a8d5-5bc43461e2ec None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:01:46.750749 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db5cd35-46a0-4542-a8d5-5bc43461e2ec None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:01:46.751017 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db5cd35-46a0-4542-a8d5-5bc43461e2ec None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:01:46.760651 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db5cd35-46a0-4542-a8d5-5bc43461e2ec None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:01:46.762123 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db5cd35-46a0-4542-a8d5-5bc43461e2ec None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:01:46.778311 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application [None req-1db5cd35-46a0-4542-a8d5-5bc43461e2ec None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 28 19:01:46.778311 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 19:01:46.778311 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 19:01:46.778311 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 19:01:46.778311 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 19:01:46.778311 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 19:01:46.778311 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 19:01:46.778311 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 19:01:46.778311 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 19:01:46.778311 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 19:01:46.778311 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 19:01:46.778311 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 19:01:46.778311 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 28 19:01:46.778311 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 28 19:01:46.778311 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 28 19:01:46.778311 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 28 19:01:46.779296 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 19:01:46.779296 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 19:01:46.779296 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 28 19:01:46.779296 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 28 19:01:46.779296 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 28 19:01:46.779296 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 28 19:01:46.779296 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 19:01:46.779296 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 19:01:46.779296 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 19:01:46.779296 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 19:01:46.779296 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 19:01:46.779296 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application with Lock( Oct 28 19:01:46.779296 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 19:01:46.779296 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._enter() Oct 28 19:01:46.779296 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 19:01:46.779296 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 19:01:46.779296 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 19:01:46.779296 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.creator() Oct 28 19:01:46.780217 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 19:01:46.780217 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application created_value = creator( Oct 28 19:01:46.780217 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 28 19:01:46.780217 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 28 19:01:46.780217 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 28 19:01:46.780217 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 28 19:01:46.780217 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 28 19:01:46.780217 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 28 19:01:46.780217 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 28 19:01:46.780217 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Oct 28 19:01:46.780217 dv-cinder-862365-1-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 311/605] 10.222.0.23 () {56 vars in 1117 bytes} [Fri Oct 28 19:01:46 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 28 19:01:46.782504 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe074dac-ad6d-47a5-bc9c-b188786e80d9 None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:01:46.782504 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe074dac-ad6d-47a5-bc9c-b188786e80d9 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:01:46.782504 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe074dac-ad6d-47a5-bc9c-b188786e80d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:01:46.804024 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-fe074dac-ad6d-47a5-bc9c-b188786e80d9 None None] MFA Rules not processed for user `ae863915635746d1ac19970949de4722`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:01:46.805204 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-fe074dac-ad6d-47a5-bc9c-b188786e80d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:01:46.838908 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f8a0d7-8427-4d6f-a797-aeadd685227c None None] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:01:46.868148 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:01:46.873817 dv-cinder-862365-1-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 312/606] 10.222.0.23 () {58 vars in 1024 bytes} [Fri Oct 28 19:01:46 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 28 19:01:46.877941 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe074dac-ad6d-47a5-bc9c-b188786e80d9 None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:01:46.883874 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5fa1d8-7b74-4d90-8f89-39f6fc1a5181 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:01:46.884487 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5fa1d8-7b74-4d90-8f89-39f6fc1a5181 None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:01:46.884800 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5fa1d8-7b74-4d90-8f89-39f6fc1a5181 None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:01:46.885077 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5fa1d8-7b74-4d90-8f89-39f6fc1a5181 None admin] PATH_INFO: `/v3/roles` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:01:46.885828 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b5fa1d8-7b74-4d90-8f89-39f6fc1a5181 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81765) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:01:46.886132 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b5fa1d8-7b74-4d90-8f89-39f6fc1a5181 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:01:46.887601 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b5fa1d8-7b74-4d90-8f89-39f6fc1a5181 None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:01:46.899675 dv-cinder-862365-1-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 295/607] 10.222.0.23 () {56 vars in 1099 bytes} [Fri Oct 28 19:01:46 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:01:46.906178 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2f9c86-aa0c-44ed-90a0-93479810cb94 None None] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:01:46.906469 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2f9c86-aa0c-44ed-90a0-93479810cb94 None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:01:46.906750 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2f9c86-aa0c-44ed-90a0-93479810cb94 None None] PATH_INFO: `/` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:01:46.908808 dv-cinder-862365-1-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 296/608] 10.222.0.23 () {54 vars in 927 bytes} [Fri Oct 28 19:01:46 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 19:01:46.909819 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2f9c86-aa0c-44ed-90a0-93479810cb94 None None] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:01:46.942099 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:01:47.005176 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe074dac-ad6d-47a5-bc9c-b188786e80d9 None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:01:47.020267 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2f9c86-aa0c-44ed-90a0-93479810cb94 None None] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:01:47.046436 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c974ab49-11f0-4a6a-a748-f7b7c66b0ac1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:01:47.047050 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c974ab49-11f0-4a6a-a748-f7b7c66b0ac1 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:01:47.047380 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c974ab49-11f0-4a6a-a748-f7b7c66b0ac1 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:01:47.047589 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c974ab49-11f0-4a6a-a748-f7b7c66b0ac1 None admin] PATH_INFO: `/v3/users` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:01:47.048319 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c974ab49-11f0-4a6a-a748-f7b7c66b0ac1 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:01:47.048626 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c974ab49-11f0-4a6a-a748-f7b7c66b0ac1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:01:47.050516 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c974ab49-11f0-4a6a-a748-f7b7c66b0ac1 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:01:47.058377 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e49cac-e603-4970-9b10-40fd6576fa4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:01:47.059372 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e49cac-e603-4970-9b10-40fd6576fa4f None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:01:47.059898 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e49cac-e603-4970-9b10-40fd6576fa4f None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:01:47.060377 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e49cac-e603-4970-9b10-40fd6576fa4f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:01:47.071034 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e49cac-e603-4970-9b10-40fd6576fa4f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:01:47.072825 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e49cac-e603-4970-9b10-40fd6576fa4f None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:01:47.073540 dv-cinder-862365-1-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 313/609] 10.222.0.23 () {56 vars in 1149 bytes} [Fri Oct 28 19:01:46 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:01:47.074813 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d75373-da18-48f1-b13c-66c367b57c2e None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:01:47.075114 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d75373-da18-48f1-b13c-66c367b57c2e None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:01:47.075544 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d75373-da18-48f1-b13c-66c367b57c2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:01:47.090281 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application [None req-19e49cac-e603-4970-9b10-40fd6576fa4f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 19:01:47.090281 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 19:01:47.090281 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 19:01:47.090281 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 19:01:47.090281 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 19:01:47.090281 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 19:01:47.090281 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 19:01:47.090281 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 19:01:47.090281 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 19:01:47.090281 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 19:01:47.090281 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 19:01:47.090281 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 19:01:47.090281 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 28 19:01:47.090281 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 28 19:01:47.090281 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 28 19:01:47.090281 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 28 19:01:47.091257 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 19:01:47.091257 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 19:01:47.091257 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 19:01:47.091257 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 19:01:47.091257 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 19:01:47.091257 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 19:01:47.091257 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 19:01:47.091257 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application with Lock( Oct 28 19:01:47.091257 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 19:01:47.091257 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._enter() Oct 28 19:01:47.091257 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 19:01:47.091257 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 19:01:47.091257 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 19:01:47.091257 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.creator() Oct 28 19:01:47.091257 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 19:01:47.091257 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application created_value = creator( Oct 28 19:01:47.091257 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 28 19:01:47.092160 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 28 19:01:47.092160 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 19:01:47.092160 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application Oct 28 19:01:47.094669 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-89d75373-da18-48f1-b13c-66c367b57c2e None None] MFA Rules not processed for user `ae863915635746d1ac19970949de4722`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:01:47.095545 dv-cinder-862365-1-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 297/610] 10.222.0.23 () {56 vars in 1108 bytes} [Fri Oct 28 19:01:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 19:01:47.096653 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e49cac-e603-4970-9b10-40fd6576fa4f None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:01:47.100562 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-89d75373-da18-48f1-b13c-66c367b57c2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:01:47.157906 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:01:47.175093 dv-cinder-862365-1-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 314/611] 10.222.0.23 () {58 vars in 1024 bytes} [Fri Oct 28 19:01:47 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 28 19:01:47.176411 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d75373-da18-48f1-b13c-66c367b57c2e None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:01:47.184015 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:01:47.210846 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e49cac-e603-4970-9b10-40fd6576fa4f None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:01:47.253451 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8c1489-d765-4b89-a455-e4c79e3a09e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:01:47.254476 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8c1489-d765-4b89-a455-e4c79e3a09e9 None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:01:47.255604 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8c1489-d765-4b89-a455-e4c79e3a09e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:01:47.256531 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8c1489-d765-4b89-a455-e4c79e3a09e9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:01:47.297498 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d75373-da18-48f1-b13c-66c367b57c2e None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:01:47.333929 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c30523-38e7-4543-9ff5-0787e115eb55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:01:47.334887 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c30523-38e7-4543-9ff5-0787e115eb55 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:01:47.335507 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c30523-38e7-4543-9ff5-0787e115eb55 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:01:47.335974 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c30523-38e7-4543-9ff5-0787e115eb55 None admin] PATH_INFO: `/v3/domains` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:01:47.337146 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c30523-38e7-4543-9ff5-0787e115eb55 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:01:47.337671 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c30523-38e7-4543-9ff5-0787e115eb55 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:01:47.339747 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c30523-38e7-4543-9ff5-0787e115eb55 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:01:47.344365 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df8c1489-d765-4b89-a455-e4c79e3a09e9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:01:47.346023 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df8c1489-d765-4b89-a455-e4c79e3a09e9 None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:01:47.354152 dv-cinder-862365-1-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 315/612] 10.222.0.23 () {56 vars in 1109 bytes} [Fri Oct 28 19:01:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:01:47.355310 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c30523-38e7-4543-9ff5-0787e115eb55 None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:01:47.418948 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:01:47.450838 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:01:47.480209 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c30523-38e7-4543-9ff5-0787e115eb55 None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:01:47.486876 dv-cinder-862365-1-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 298/613] 10.222.0.23 () {58 vars in 1282 bytes} [Fri Oct 28 19:01:47 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 391 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 28 19:01:47.487992 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8c1489-d765-4b89-a455-e4c79e3a09e9 None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:01:47.517194 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b826514-4d1f-481a-9a89-d5466ad9008f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:01:47.518182 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b826514-4d1f-481a-9a89-d5466ad9008f None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:01:47.518467 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b826514-4d1f-481a-9a89-d5466ad9008f None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:01:47.518725 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b826514-4d1f-481a-9a89-d5466ad9008f None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:01:47.519308 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b826514-4d1f-481a-9a89-d5466ad9008f None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:01:47.520699 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b826514-4d1f-481a-9a89-d5466ad9008f None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:01:47.531365 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application [None req-7b826514-4d1f-481a-9a89-d5466ad9008f None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 28 19:01:47.531365 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 19:01:47.531365 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 28 19:01:47.531365 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 28 19:01:47.531365 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 28 19:01:47.531365 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 28 19:01:47.531365 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 28 19:01:47.531365 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 28 19:01:47.531365 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 28 19:01:47.531365 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Oct 28 19:01:47.531365 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 28 19:01:47.531365 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Oct 28 19:01:47.531365 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 19:01:47.531365 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 19:01:47.531365 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 19:01:47.531365 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 19:01:47.531365 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 19:01:47.532390 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 19:01:47.532390 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 19:01:47.532390 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 19:01:47.532390 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 19:01:47.532390 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 19:01:47.532390 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 19:01:47.532390 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 28 19:01:47.532390 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 28 19:01:47.532390 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 28 19:01:47.532390 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 28 19:01:47.532390 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 19:01:47.532390 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 19:01:47.532390 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 19:01:47.532390 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 19:01:47.532390 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 19:01:47.532390 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 19:01:47.533232 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 19:01:47.533232 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application with Lock( Oct 28 19:01:47.533232 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 19:01:47.533232 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._enter() Oct 28 19:01:47.533232 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 19:01:47.533232 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 19:01:47.533232 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 19:01:47.533232 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.creator() Oct 28 19:01:47.533232 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 19:01:47.533232 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application created_value = creator( Oct 28 19:01:47.533232 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 28 19:01:47.533232 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 28 19:01:47.533232 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 28 19:01:47.533232 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Oct 28 19:01:47.533232 dv-cinder-862365-1-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 316/614] 10.222.0.23 () {56 vars in 1129 bytes} [Fri Oct 28 19:01:47 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 19:01:47.534083 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b826514-4d1f-481a-9a89-d5466ad9008f None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:01:47.595127 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8c1489-d765-4b89-a455-e4c79e3a09e9 None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:01:47.627544 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c92e29-34b0-4f0d-95b7-b0db9e7d122a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:01:47.628103 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c92e29-34b0-4f0d-95b7-b0db9e7d122a None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:01:47.628387 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c92e29-34b0-4f0d-95b7-b0db9e7d122a None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:01:47.628656 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c92e29-34b0-4f0d-95b7-b0db9e7d122a None admin] PATH_INFO: `/v3/users/swift` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:01:47.633983 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b826514-4d1f-481a-9a89-d5466ad9008f None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:01:47.636020 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c92e29-34b0-4f0d-95b7-b0db9e7d122a None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:01:47.637566 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c92e29-34b0-4f0d-95b7-b0db9e7d122a None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:01:47.644376 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:01:47.648680 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application [None req-53c92e29-34b0-4f0d-95b7-b0db9e7d122a None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Oct 28 19:01:47.648680 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 19:01:47.648680 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 19:01:47.648680 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 19:01:47.648680 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 19:01:47.648680 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 19:01:47.648680 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 19:01:47.648680 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 19:01:47.648680 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 19:01:47.648680 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 19:01:47.648680 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 19:01:47.648680 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 19:01:47.648680 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 28 19:01:47.648680 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 28 19:01:47.648680 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 28 19:01:47.648680 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 28 19:01:47.649683 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 19:01:47.649683 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 19:01:47.649683 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 28 19:01:47.649683 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 28 19:01:47.649683 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 28 19:01:47.649683 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 28 19:01:47.649683 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 19:01:47.649683 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 19:01:47.649683 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 19:01:47.649683 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 19:01:47.649683 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 19:01:47.649683 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application with Lock( Oct 28 19:01:47.649683 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 19:01:47.649683 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._enter() Oct 28 19:01:47.649683 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 19:01:47.649683 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 19:01:47.649683 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 19:01:47.649683 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.creator() Oct 28 19:01:47.650630 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 19:01:47.650630 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application created_value = creator( Oct 28 19:01:47.650630 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 28 19:01:47.650630 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 28 19:01:47.650630 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 28 19:01:47.650630 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 28 19:01:47.650630 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 28 19:01:47.650630 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 28 19:01:47.650630 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Oct 28 19:01:47.650630 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application Oct 28 19:01:47.650630 dv-cinder-862365-1-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 299/615] 10.222.0.23 () {56 vars in 1096 bytes} [Fri Oct 28 19:01:47 2022] GET /identity/v3/users/swift => generated 83 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 19:01:47.650630 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c92e29-34b0-4f0d-95b7-b0db9e7d122a None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:01:47.669488 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05d13a1-8eef-4423-bb6b-9fa4ea70c2c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:01:47.670110 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05d13a1-8eef-4423-bb6b-9fa4ea70c2c4 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:01:47.670384 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05d13a1-8eef-4423-bb6b-9fa4ea70c2c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:01:47.670653 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05d13a1-8eef-4423-bb6b-9fa4ea70c2c4 None admin] PATH_INFO: `/v3/services/network` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:01:47.671222 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05d13a1-8eef-4423-bb6b-9fa4ea70c2c4 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:01:47.672567 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05d13a1-8eef-4423-bb6b-9fa4ea70c2c4 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:01:47.681414 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application [None req-e05d13a1-8eef-4423-bb6b-9fa4ea70c2c4 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Oct 28 19:01:47.681414 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 19:01:47.681414 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 28 19:01:47.681414 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 28 19:01:47.681414 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 28 19:01:47.681414 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 28 19:01:47.681414 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 28 19:01:47.681414 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 28 19:01:47.681414 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Oct 28 19:01:47.681414 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Oct 28 19:01:47.681414 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 28 19:01:47.681414 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Oct 28 19:01:47.681414 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 19:01:47.681414 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 19:01:47.681414 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 19:01:47.681414 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 19:01:47.681414 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 19:01:47.682408 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 19:01:47.682408 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 19:01:47.682408 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 19:01:47.682408 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 19:01:47.682408 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 19:01:47.682408 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 19:01:47.682408 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 28 19:01:47.682408 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 28 19:01:47.682408 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 28 19:01:47.682408 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 28 19:01:47.682408 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 19:01:47.682408 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 19:01:47.682408 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 19:01:47.682408 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 19:01:47.682408 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 19:01:47.682408 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 19:01:47.683259 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 19:01:47.683259 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application with Lock( Oct 28 19:01:47.683259 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 19:01:47.683259 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._enter() Oct 28 19:01:47.683259 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 19:01:47.683259 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 19:01:47.683259 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 19:01:47.683259 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.creator() Oct 28 19:01:47.683259 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 19:01:47.683259 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application created_value = creator( Oct 28 19:01:47.683259 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 28 19:01:47.683259 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 28 19:01:47.683259 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Oct 28 19:01:47.683259 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Oct 28 19:01:47.683259 dv-cinder-862365-1-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 317/616] 10.222.0.23 () {56 vars in 1111 bytes} [Fri Oct 28 19:01:47 2022] GET /identity/v3/services/network => generated 88 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 19:01:47.684046 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05d13a1-8eef-4423-bb6b-9fa4ea70c2c4 None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:01:47.685093 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:01:47.749448 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c92e29-34b0-4f0d-95b7-b0db9e7d122a None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:01:47.783178 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8346eba4-0432-44f6-a6c4-c41bc76d1f5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:01:47.783797 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8346eba4-0432-44f6-a6c4-c41bc76d1f5c None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:01:47.784072 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8346eba4-0432-44f6-a6c4-c41bc76d1f5c None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:01:47.784340 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8346eba4-0432-44f6-a6c4-c41bc76d1f5c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:01:47.784468 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05d13a1-8eef-4423-bb6b-9fa4ea70c2c4 None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:01:47.794716 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8346eba4-0432-44f6-a6c4-c41bc76d1f5c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:01:47.796149 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8346eba4-0432-44f6-a6c4-c41bc76d1f5c None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:01:47.810486 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application [None req-8346eba4-0432-44f6-a6c4-c41bc76d1f5c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 19:01:47.810486 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 19:01:47.810486 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 19:01:47.810486 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 19:01:47.810486 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 19:01:47.810486 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 19:01:47.810486 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 19:01:47.810486 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 19:01:47.810486 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 19:01:47.810486 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 19:01:47.810486 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 19:01:47.810486 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 19:01:47.810486 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 28 19:01:47.810486 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 28 19:01:47.810486 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 28 19:01:47.810486 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 28 19:01:47.811622 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 19:01:47.811622 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 19:01:47.811622 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 19:01:47.811622 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 19:01:47.811622 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 19:01:47.811622 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 19:01:47.811622 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 19:01:47.811622 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application with Lock( Oct 28 19:01:47.811622 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 19:01:47.811622 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._enter() Oct 28 19:01:47.811622 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 19:01:47.811622 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 19:01:47.811622 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 19:01:47.811622 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.creator() Oct 28 19:01:47.811622 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 19:01:47.811622 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application created_value = creator( Oct 28 19:01:47.811622 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 28 19:01:47.812785 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 28 19:01:47.812785 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 19:01:47.812785 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application Oct 28 19:01:47.816078 dv-cinder-862365-1-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 300/617] 10.222.0.23 () {56 vars in 1108 bytes} [Fri Oct 28 19:01:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 19:01:47.817264 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677ac19e-45f5-4048-aca5-6554fa63503d None None] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:01:47.817573 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677ac19e-45f5-4048-aca5-6554fa63503d None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:01:47.817850 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677ac19e-45f5-4048-aca5-6554fa63503d None None] PATH_INFO: `/` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:01:47.819084 dv-cinder-862365-1-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 301/618] 10.222.0.23 () {54 vars in 927 bytes} [Fri Oct 28 19:01:47 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 19:01:47.819774 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677ac19e-45f5-4048-aca5-6554fa63503d None None] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:01:47.820608 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1d55f0-1115-4348-b65b-3e180255c2b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:01:47.821403 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1d55f0-1115-4348-b65b-3e180255c2b3 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:01:47.821896 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1d55f0-1115-4348-b65b-3e180255c2b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:01:47.822227 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1d55f0-1115-4348-b65b-3e180255c2b3 None admin] PATH_INFO: `/v3/services` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:01:47.823580 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1d55f0-1115-4348-b65b-3e180255c2b3 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:01:47.823900 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1d55f0-1115-4348-b65b-3e180255c2b3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:01:47.825264 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1d55f0-1115-4348-b65b-3e180255c2b3 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:01:47.830382 dv-cinder-862365-1-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 318/619] 10.222.0.23 () {56 vars in 1124 bytes} [Fri Oct 28 19:01:47 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:01:47.831339 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1d55f0-1115-4348-b65b-3e180255c2b3 None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:01:47.872845 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:01:47.913578 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:01:47.926476 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677ac19e-45f5-4048-aca5-6554fa63503d None None] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:01:47.931401 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1d55f0-1115-4348-b65b-3e180255c2b3 None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:01:47.960761 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99f2fd8-44f4-44f9-a43a-6d2643bca76a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:01:47.961565 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99f2fd8-44f4-44f9-a43a-6d2643bca76a None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:01:47.961850 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99f2fd8-44f4-44f9-a43a-6d2643bca76a None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:01:47.962120 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99f2fd8-44f4-44f9-a43a-6d2643bca76a None admin] PATH_INFO: `/v3/users` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:01:47.963333 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99f2fd8-44f4-44f9-a43a-6d2643bca76a None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81765) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:01:47.965652 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99f2fd8-44f4-44f9-a43a-6d2643bca76a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:01:47.966025 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59fda7dd-39dd-47f3-8f8b-93f4aa9b045c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:01:47.966659 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fda7dd-39dd-47f3-8f8b-93f4aa9b045c None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:01:47.966905 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fda7dd-39dd-47f3-8f8b-93f4aa9b045c None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:01:47.967178 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fda7dd-39dd-47f3-8f8b-93f4aa9b045c None admin] PATH_INFO: `/v3/services` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:01:47.967592 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99f2fd8-44f4-44f9-a43a-6d2643bca76a None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:01:47.967795 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59fda7dd-39dd-47f3-8f8b-93f4aa9b045c None admin] RBAC: Adding query filter params (name=network) {{(pid=81766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:01:47.968099 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59fda7dd-39dd-47f3-8f8b-93f4aa9b045c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:01:47.969789 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59fda7dd-39dd-47f3-8f8b-93f4aa9b045c None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:01:47.975882 dv-cinder-862365-1-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 319/620] 10.222.0.23 () {56 vars in 1112 bytes} [Fri Oct 28 19:01:47 2022] GET /identity/v3/services?name=network => generated 124 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:01:47.976927 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59fda7dd-39dd-47f3-8f8b-93f4aa9b045c None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:01:47.994525 dv-cinder-862365-1-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 302/621] 10.222.0.23 () {56 vars in 1135 bytes} [Fri Oct 28 19:01:47 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:01:47.995822 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edc043e-0267-4c7a-8d60-87248646d86f None None] REQUEST_METHOD: `POST` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:01:47.996114 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edc043e-0267-4c7a-8d60-87248646d86f None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:01:47.996383 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edc043e-0267-4c7a-8d60-87248646d86f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:01:48.013949 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.auth.core [None req-1edc043e-0267-4c7a-8d60-87248646d86f None None] MFA Rules not processed for user `ae863915635746d1ac19970949de4722`. Rule list: `[]` (Enabled: `True`). {{(pid=81765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:01:48.015146 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-1edc043e-0267-4c7a-8d60-87248646d86f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:01:48.075213 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59fda7dd-39dd-47f3-8f8b-93f4aa9b045c None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:01:48.076707 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:01:48.083409 dv-cinder-862365-1-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 303/622] 10.222.0.23 () {58 vars in 1024 bytes} [Fri Oct 28 19:01:47 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 28 19:01:48.084232 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1edc043e-0267-4c7a-8d60-87248646d86f None None] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:01:48.110350 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ecea8f-fcfd-4455-b5b0-2e308f72fff6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:01:48.110957 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ecea8f-fcfd-4455-b5b0-2e308f72fff6 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:01:48.111239 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ecea8f-fcfd-4455-b5b0-2e308f72fff6 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:01:48.111512 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ecea8f-fcfd-4455-b5b0-2e308f72fff6 None admin] PATH_INFO: `/v3/domains` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:01:48.112144 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ecea8f-fcfd-4455-b5b0-2e308f72fff6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:01:48.112447 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ecea8f-fcfd-4455-b5b0-2e308f72fff6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:01:48.113867 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ecea8f-fcfd-4455-b5b0-2e308f72fff6 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:01:48.125918 dv-cinder-862365-1-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 320/623] 10.222.0.23 () {56 vars in 1109 bytes} [Fri Oct 28 19:01:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:01:48.126709 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ecea8f-fcfd-4455-b5b0-2e308f72fff6 None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:01:48.187732 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:01:48.213593 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1edc043e-0267-4c7a-8d60-87248646d86f None None] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:01:48.240064 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ecea8f-fcfd-4455-b5b0-2e308f72fff6 None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:01:48.249647 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be200d30-53a2-48d8-98ab-ac05c3a1c493 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:01:48.250258 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be200d30-53a2-48d8-98ab-ac05c3a1c493 None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:01:48.250534 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be200d30-53a2-48d8-98ab-ac05c3a1c493 None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:01:48.250808 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be200d30-53a2-48d8-98ab-ac05c3a1c493 None admin] PATH_INFO: `/v3/services` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:01:48.251424 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be200d30-53a2-48d8-98ab-ac05c3a1c493 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81765) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:01:48.251728 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be200d30-53a2-48d8-98ab-ac05c3a1c493 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:01:48.253082 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be200d30-53a2-48d8-98ab-ac05c3a1c493 None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:01:48.263541 dv-cinder-862365-1-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 304/624] 10.222.0.23 () {56 vars in 1124 bytes} [Fri Oct 28 19:01:48 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:01:48.263541 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be200d30-53a2-48d8-98ab-ac05c3a1c493 None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:01:48.282173 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa69fa6-f9c0-4962-b0b4-4479ac4ba46d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:01:48.282777 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa69fa6-f9c0-4962-b0b4-4479ac4ba46d None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:01:48.283052 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa69fa6-f9c0-4962-b0b4-4479ac4ba46d None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:01:48.283320 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa69fa6-f9c0-4962-b0b4-4479ac4ba46d None admin] PATH_INFO: `/v3/services` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:01:48.283931 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa69fa6-f9c0-4962-b0b4-4479ac4ba46d None admin] RBAC: Adding query filter params (type=network) {{(pid=81766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:01:48.284228 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa69fa6-f9c0-4962-b0b4-4479ac4ba46d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:01:48.285700 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa69fa6-f9c0-4962-b0b4-4479ac4ba46d None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:01:48.295324 dv-cinder-862365-1-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 321/625] 10.222.0.23 () {56 vars in 1112 bytes} [Fri Oct 28 19:01:48 2022] GET /identity/v3/services?type=network => generated 350 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:01:48.295324 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa69fa6-f9c0-4962-b0b4-4479ac4ba46d None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:01:48.323868 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:01:48.373892 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be200d30-53a2-48d8-98ab-ac05c3a1c493 None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:01:48.400134 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa69fa6-f9c0-4962-b0b4-4479ac4ba46d None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:01:48.408531 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e86590a-6467-41f3-9b70-f07e063cb940 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:01:48.409135 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e86590a-6467-41f3-9b70-f07e063cb940 None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:01:48.409443 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e86590a-6467-41f3-9b70-f07e063cb940 None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:01:48.409715 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e86590a-6467-41f3-9b70-f07e063cb940 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:01:48.419759 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:01:48.433735 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7724cc-b565-4f42-96ee-76a4fc651a33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:01:48.434353 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7724cc-b565-4f42-96ee-76a4fc651a33 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:01:48.434631 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7724cc-b565-4f42-96ee-76a4fc651a33 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:01:48.434900 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7724cc-b565-4f42-96ee-76a4fc651a33 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:01:48.441446 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a7724cc-b565-4f42-96ee-76a4fc651a33 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:01:48.442822 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a7724cc-b565-4f42-96ee-76a4fc651a33 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:01:48.454315 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application [None req-7a7724cc-b565-4f42-96ee-76a4fc651a33 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 28 19:01:48.454315 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 19:01:48.454315 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 19:01:48.454315 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 19:01:48.454315 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 19:01:48.454315 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 19:01:48.454315 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 19:01:48.454315 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 19:01:48.454315 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 19:01:48.454315 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 19:01:48.454315 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 19:01:48.454315 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 19:01:48.454315 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 28 19:01:48.454315 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 28 19:01:48.454315 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 28 19:01:48.455224 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 28 19:01:48.455224 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 19:01:48.455224 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 19:01:48.455224 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 19:01:48.455224 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 19:01:48.455224 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 19:01:48.455224 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 19:01:48.455224 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 19:01:48.455224 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application with Lock( Oct 28 19:01:48.455224 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 19:01:48.455224 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._enter() Oct 28 19:01:48.455224 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 19:01:48.455224 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 19:01:48.455224 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 19:01:48.455224 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.creator() Oct 28 19:01:48.455224 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 19:01:48.455224 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application created_value = creator( Oct 28 19:01:48.456107 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 28 19:01:48.456107 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 28 19:01:48.456107 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 28 19:01:48.456107 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 28 19:01:48.456107 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 28 19:01:48.456107 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 28 19:01:48.456107 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 28 19:01:48.456107 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Oct 28 19:01:48.456107 dv-cinder-862365-1-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 322/626] 10.222.0.23 () {56 vars in 1111 bytes} [Fri Oct 28 19:01:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 19:01:48.456107 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7724cc-b565-4f42-96ee-76a4fc651a33 None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:01:48.481890 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e86590a-6467-41f3-9b70-f07e063cb940 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:01:48.483336 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e86590a-6467-41f3-9b70-f07e063cb940 None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:01:48.543464 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:01:48.557990 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7724cc-b565-4f42-96ee-76a4fc651a33 None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:01:48.579774 dv-cinder-862365-1-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 305/627] 10.222.0.23 () {58 vars in 1282 bytes} [Fri Oct 28 19:01:48 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 28 19:01:48.580587 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e86590a-6467-41f3-9b70-f07e063cb940 None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:01:48.592762 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4c9438-933d-49b3-92b9-08e1f5cc116c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:01:48.593391 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4c9438-933d-49b3-92b9-08e1f5cc116c None admin] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:01:48.593672 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4c9438-933d-49b3-92b9-08e1f5cc116c None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:01:48.593942 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4c9438-933d-49b3-92b9-08e1f5cc116c None admin] PATH_INFO: `/v3/endpoints` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:01:48.594602 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4c9438-933d-49b3-92b9-08e1f5cc116c None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:01:48.595942 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4c9438-933d-49b3-92b9-08e1f5cc116c None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:01:48.622627 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:01:48.676724 dv-cinder-862365-1-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 323/628] 10.222.0.23 () {60 vars in 1144 bytes} [Fri Oct 28 19:01:48 2022] POST /identity/v3/endpoints => generated 346 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 19:01:48.677592 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4c9438-933d-49b3-92b9-08e1f5cc116c None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:01:48.678465 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e86590a-6467-41f3-9b70-f07e063cb940 None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:01:48.726111 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f386918-6821-4738-9ee4-49145e3627be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:01:48.726648 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f386918-6821-4738-9ee4-49145e3627be None admin] REQUEST_METHOD: `POST` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:01:48.726930 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f386918-6821-4738-9ee4-49145e3627be None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:01:48.727205 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f386918-6821-4738-9ee4-49145e3627be None admin] PATH_INFO: `/v3/endpoints` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:01:48.727912 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f386918-6821-4738-9ee4-49145e3627be None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:01:48.729934 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f386918-6821-4738-9ee4-49145e3627be None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:01:48.799405 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4c9438-933d-49b3-92b9-08e1f5cc116c None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:01:48.807195 dv-cinder-862365-1-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 306/629] 10.222.0.23 () {60 vars in 1144 bytes} [Fri Oct 28 19:01:48 2022] POST /identity/v3/endpoints => generated 337 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 19:01:48.808378 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f386918-6821-4738-9ee4-49145e3627be None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:01:48.887742 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb22dff1-5831-4a2b-aa22-cac3bedf231e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:01:48.888375 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb22dff1-5831-4a2b-aa22-cac3bedf231e None admin] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:01:48.889015 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb22dff1-5831-4a2b-aa22-cac3bedf231e None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:01:48.889298 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb22dff1-5831-4a2b-aa22-cac3bedf231e None admin] PATH_INFO: `/v3/services` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:01:48.890255 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb22dff1-5831-4a2b-aa22-cac3bedf231e None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:01:48.891848 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb22dff1-5831-4a2b-aa22-cac3bedf231e None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:01:48.946036 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:01:48.952716 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:01:48.962483 dv-cinder-862365-1-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 324/630] 10.222.0.23 () {60 vars in 1141 bytes} [Fri Oct 28 19:01:48 2022] POST /identity/v3/services => generated 269 bytes in 285 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 19:01:48.963908 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb22dff1-5831-4a2b-aa22-cac3bedf231e None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:01:48.966580 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f386918-6821-4738-9ee4-49145e3627be None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:01:49.013931 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a317a842-e615-4f4a-a0ce-3236861ce345 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:01:49.014570 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a317a842-e615-4f4a-a0ce-3236861ce345 None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:01:49.014910 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a317a842-e615-4f4a-a0ce-3236861ce345 None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:01:49.015192 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a317a842-e615-4f4a-a0ce-3236861ce345 None admin] PATH_INFO: `/v3/projects` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:01:49.015924 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a317a842-e615-4f4a-a0ce-3236861ce345 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81765) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:01:49.016234 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a317a842-e615-4f4a-a0ce-3236861ce345 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:01:49.017800 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a317a842-e615-4f4a-a0ce-3236861ce345 None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:01:49.033300 dv-cinder-862365-1-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 307/631] 10.222.0.23 () {56 vars in 1148 bytes} [Fri Oct 28 19:01:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:01:49.039538 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a317a842-e615-4f4a-a0ce-3236861ce345 None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:01:49.106454 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb22dff1-5831-4a2b-aa22-cac3bedf231e None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:01:49.146588 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9210efd-fa4d-40ba-90df-a246db728006 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:01:49.147247 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9210efd-fa4d-40ba-90df-a246db728006 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:01:49.147534 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9210efd-fa4d-40ba-90df-a246db728006 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:01:49.147805 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9210efd-fa4d-40ba-90df-a246db728006 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:01:49.164150 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9210efd-fa4d-40ba-90df-a246db728006 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:01:49.165697 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9210efd-fa4d-40ba-90df-a246db728006 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:01:49.183284 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application [None req-b9210efd-fa4d-40ba-90df-a246db728006 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 19:01:49.183284 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 19:01:49.183284 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 19:01:49.183284 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 19:01:49.183284 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 19:01:49.183284 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 19:01:49.183284 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 19:01:49.183284 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 19:01:49.183284 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 19:01:49.183284 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 19:01:49.183284 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 19:01:49.183284 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 19:01:49.183284 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 28 19:01:49.183284 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 28 19:01:49.183284 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 28 19:01:49.183284 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 28 19:01:49.184393 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 19:01:49.184393 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 19:01:49.184393 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 19:01:49.184393 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 19:01:49.184393 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 19:01:49.184393 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 19:01:49.184393 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 19:01:49.184393 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application with Lock( Oct 28 19:01:49.184393 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 19:01:49.184393 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._enter() Oct 28 19:01:49.184393 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 19:01:49.184393 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 19:01:49.184393 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 19:01:49.184393 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.creator() Oct 28 19:01:49.184393 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 19:01:49.184393 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application created_value = creator( Oct 28 19:01:49.184393 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 28 19:01:49.185273 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 28 19:01:49.185273 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 19:01:49.185273 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Oct 28 19:01:49.189205 dv-cinder-862365-1-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 325/632] 10.222.0.23 () {56 vars in 1108 bytes} [Fri Oct 28 19:01:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 19:01:49.190020 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a317a842-e615-4f4a-a0ce-3236861ce345 None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:01:49.190423 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9210efd-fa4d-40ba-90df-a246db728006 None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:01:49.250480 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea86bd0d-69d6-444a-8a1a-c6455688568c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:01:49.251097 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea86bd0d-69d6-444a-8a1a-c6455688568c None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:01:49.251379 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea86bd0d-69d6-444a-8a1a-c6455688568c None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:01:49.251651 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea86bd0d-69d6-444a-8a1a-c6455688568c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:01:49.253059 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea86bd0d-69d6-444a-8a1a-c6455688568c None admin] RBAC: Adding query filter params (role.id=068b73485c0e46cb8a8d88b948028746, scope.project.id=b705897907f042c0818a931052438e1e, user.id=820bee57d7dc4c5a962107e97f050835) {{(pid=81765) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:01:49.253059 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea86bd0d-69d6-444a-8a1a-c6455688568c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:01:49.254114 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea86bd0d-69d6-444a-8a1a-c6455688568c None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:01:49.261259 dv-cinder-862365-1-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 308/633] 10.222.0.23 () {56 vars in 1374 bytes} [Fri Oct 28 19:01:49 2022] GET /identity/v3/role_assignments?user.id=820bee57d7dc4c5a962107e97f050835&scope.project.id=b705897907f042c0818a931052438e1e&role.id=068b73485c0e46cb8a8d88b948028746 => generated 608 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 19:01:49.272459 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:01:49.334810 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9210efd-fa4d-40ba-90df-a246db728006 None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:01:49.374778 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7ece0c-ddb0-4ce9-9741-e4f5b9ed0036 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:01:49.375466 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7ece0c-ddb0-4ce9-9741-e4f5b9ed0036 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:01:49.375743 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7ece0c-ddb0-4ce9-9741-e4f5b9ed0036 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:01:49.376015 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7ece0c-ddb0-4ce9-9741-e4f5b9ed0036 None admin] PATH_INFO: `/v3/domains` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:01:49.376719 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7ece0c-ddb0-4ce9-9741-e4f5b9ed0036 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:01:49.377019 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7ece0c-ddb0-4ce9-9741-e4f5b9ed0036 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:01:49.378467 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7ece0c-ddb0-4ce9-9741-e4f5b9ed0036 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:01:49.392924 dv-cinder-862365-1-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 326/634] 10.222.0.23 () {56 vars in 1109 bytes} [Fri Oct 28 19:01:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:01:49.398402 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea86bd0d-69d6-444a-8a1a-c6455688568c None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:01:49.415224 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:01:49.504374 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea86bd0d-69d6-444a-8a1a-c6455688568c None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:01:49.539891 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f43824-92f4-437f-bbea-9324340c5852 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:01:49.540443 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f43824-92f4-437f-bbea-9324340c5852 None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:01:49.540724 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f43824-92f4-437f-bbea-9324340c5852 None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:01:49.541613 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f43824-92f4-437f-bbea-9324340c5852 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:01:49.548529 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f43824-92f4-437f-bbea-9324340c5852 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:01:49.550079 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f43824-92f4-437f-bbea-9324340c5852 None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:01:49.561556 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application [None req-73f43824-92f4-437f-bbea-9324340c5852 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 28 19:01:49.561556 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 19:01:49.561556 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 19:01:49.561556 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 19:01:49.561556 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 19:01:49.561556 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 19:01:49.561556 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 19:01:49.561556 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 19:01:49.561556 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 19:01:49.561556 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 19:01:49.561556 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 19:01:49.561556 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 19:01:49.561556 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 28 19:01:49.561556 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 28 19:01:49.561556 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 28 19:01:49.562532 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 28 19:01:49.562532 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 19:01:49.562532 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 19:01:49.562532 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 19:01:49.562532 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 19:01:49.562532 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 19:01:49.562532 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 19:01:49.562532 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 19:01:49.562532 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application with Lock( Oct 28 19:01:49.562532 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 19:01:49.562532 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._enter() Oct 28 19:01:49.562532 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 19:01:49.562532 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 19:01:49.562532 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 19:01:49.562532 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.creator() Oct 28 19:01:49.562532 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 19:01:49.562532 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application created_value = creator( Oct 28 19:01:49.564076 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 28 19:01:49.564076 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 28 19:01:49.564076 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 28 19:01:49.564076 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 28 19:01:49.564076 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 28 19:01:49.564076 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 28 19:01:49.564076 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 28 19:01:49.564076 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application Oct 28 19:01:49.564076 dv-cinder-862365-1-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 309/635] 10.222.0.23 () {56 vars in 1111 bytes} [Fri Oct 28 19:01:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 19:01:49.568761 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7ece0c-ddb0-4ce9-9741-e4f5b9ed0036 None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:01:49.674963 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7ece0c-ddb0-4ce9-9741-e4f5b9ed0036 None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:01:49.686141 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:01:49.714747 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fabf748-8bfc-4afd-8ae6-67e1488071db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:01:49.715360 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fabf748-8bfc-4afd-8ae6-67e1488071db None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:01:49.715639 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fabf748-8bfc-4afd-8ae6-67e1488071db None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:01:49.715910 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fabf748-8bfc-4afd-8ae6-67e1488071db None admin] PATH_INFO: `/v3/projects` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:01:49.716595 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fabf748-8bfc-4afd-8ae6-67e1488071db None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:01:49.716901 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fabf748-8bfc-4afd-8ae6-67e1488071db None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:01:49.718353 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fabf748-8bfc-4afd-8ae6-67e1488071db None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:01:49.730573 dv-cinder-862365-1-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 327/636] 10.222.0.23 () {56 vars in 1148 bytes} [Fri Oct 28 19:01:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:01:49.737365 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f43824-92f4-437f-bbea-9324340c5852 None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:01:49.809544 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:01:49.842238 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f43824-92f4-437f-bbea-9324340c5852 None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:01:49.876357 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af06005a-5030-41cc-80f0-94fbcbf20a7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:01:49.876964 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af06005a-5030-41cc-80f0-94fbcbf20a7a None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:01:49.877244 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af06005a-5030-41cc-80f0-94fbcbf20a7a None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:01:49.877563 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af06005a-5030-41cc-80f0-94fbcbf20a7a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:01:49.878287 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af06005a-5030-41cc-80f0-94fbcbf20a7a None admin] RBAC: Adding query filter params (role.id=a9e4e47c2bf448fcbada91c1174644f7, scope.project.id=b705897907f042c0818a931052438e1e, user.id=ddd2863f2113472cb20577990b5c55d7) {{(pid=81765) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:01:49.878596 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af06005a-5030-41cc-80f0-94fbcbf20a7a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:01:49.880018 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af06005a-5030-41cc-80f0-94fbcbf20a7a None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:01:49.886977 dv-cinder-862365-1-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 310/637] 10.222.0.23 () {56 vars in 1374 bytes} [Fri Oct 28 19:01:49 2022] GET /identity/v3/role_assignments?user.id=ddd2863f2113472cb20577990b5c55d7&scope.project.id=b705897907f042c0818a931052438e1e&role.id=a9e4e47c2bf448fcbada91c1174644f7 => generated 608 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:01:50.949056 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754faad8-2436-44e3-a238-d1c47fe79891 None None] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:01:50.950119 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754faad8-2436-44e3-a238-d1c47fe79891 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:01:50.950617 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754faad8-2436-44e3-a238-d1c47fe79891 None None] PATH_INFO: `/` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:01:50.952402 dv-cinder-862365-1-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 328/638] 10.222.0.23 () {54 vars in 927 bytes} [Fri Oct 28 19:01:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 19:01:50.957716 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27274bf6-f3ef-4d8b-96ea-9acdf0c384dc None None] REQUEST_METHOD: `POST` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:01:50.958504 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27274bf6-f3ef-4d8b-96ea-9acdf0c384dc None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:01:50.958985 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27274bf6-f3ef-4d8b-96ea-9acdf0c384dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:01:50.978279 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.auth.core [None req-27274bf6-f3ef-4d8b-96ea-9acdf0c384dc None None] MFA Rules not processed for user `ae863915635746d1ac19970949de4722`. Rule list: `[]` (Enabled: `True`). {{(pid=81765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:01:50.980343 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-27274bf6-f3ef-4d8b-96ea-9acdf0c384dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:01:51.050507 dv-cinder-862365-1-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 311/639] 10.222.0.23 () {58 vars in 1024 bytes} [Fri Oct 28 19:01:50 2022] POST /identity/v3/auth/tokens => generated 1271 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 28 19:01:51.318537 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754faad8-2436-44e3-a238-d1c47fe79891 None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:01:51.427744 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754faad8-2436-44e3-a238-d1c47fe79891 None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:01:51.431093 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043302f7-ebff-4baf-9a98-5efc5eaa137e None None] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:01:51.431761 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043302f7-ebff-4baf-9a98-5efc5eaa137e None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:01:51.432269 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043302f7-ebff-4baf-9a98-5efc5eaa137e None None] PATH_INFO: `/` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:01:51.434256 dv-cinder-862365-1-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 312/640] 10.222.0.23 () {54 vars in 927 bytes} [Fri Oct 28 19:01:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 19:01:51.440340 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881694e6-3c18-4ad5-a84e-ce247ef75ae6 None None] REQUEST_METHOD: `POST` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:01:51.440984 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881694e6-3c18-4ad5-a84e-ce247ef75ae6 None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:01:51.441494 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881694e6-3c18-4ad5-a84e-ce247ef75ae6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:01:51.461171 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.auth.core [None req-881694e6-3c18-4ad5-a84e-ce247ef75ae6 None None] MFA Rules not processed for user `ae863915635746d1ac19970949de4722`. Rule list: `[]` (Enabled: `True`). {{(pid=81765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:01:51.463611 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-881694e6-3c18-4ad5-a84e-ce247ef75ae6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:01:51.467070 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a074d5c8-4f10-41d8-8ac1-fd3d9d532dfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:01:51.467715 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a074d5c8-4f10-41d8-8ac1-fd3d9d532dfd None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:01:51.467996 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a074d5c8-4f10-41d8-8ac1-fd3d9d532dfd None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:01:51.468270 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a074d5c8-4f10-41d8-8ac1-fd3d9d532dfd None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:01:51.468844 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a074d5c8-4f10-41d8-8ac1-fd3d9d532dfd None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:01:51.470232 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a074d5c8-4f10-41d8-8ac1-fd3d9d532dfd None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:01:51.479946 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application [None req-a074d5c8-4f10-41d8-8ac1-fd3d9d532dfd None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 28 19:01:51.479946 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 19:01:51.479946 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 28 19:01:51.479946 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 28 19:01:51.479946 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 28 19:01:51.479946 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 28 19:01:51.479946 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 28 19:01:51.479946 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 28 19:01:51.479946 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 28 19:01:51.479946 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Oct 28 19:01:51.479946 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 28 19:01:51.479946 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Oct 28 19:01:51.479946 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 19:01:51.479946 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 19:01:51.479946 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 19:01:51.479946 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 19:01:51.479946 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 19:01:51.481012 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 19:01:51.481012 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 19:01:51.481012 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 19:01:51.481012 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 19:01:51.481012 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 19:01:51.481012 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 19:01:51.481012 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 28 19:01:51.481012 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 28 19:01:51.481012 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 28 19:01:51.481012 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 28 19:01:51.481012 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 19:01:51.481012 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 19:01:51.481012 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 19:01:51.481012 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 19:01:51.481012 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 19:01:51.481012 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 19:01:51.482042 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 19:01:51.482042 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application with Lock( Oct 28 19:01:51.482042 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 19:01:51.482042 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._enter() Oct 28 19:01:51.482042 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 19:01:51.482042 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 19:01:51.482042 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 19:01:51.482042 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.creator() Oct 28 19:01:51.482042 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 19:01:51.482042 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application created_value = creator( Oct 28 19:01:51.482042 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 28 19:01:51.482042 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 28 19:01:51.482042 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 28 19:01:51.482042 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Oct 28 19:01:51.482042 dv-cinder-862365-1-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 329/641] 10.222.0.23 () {56 vars in 1114 bytes} [Fri Oct 28 19:01:51 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 19:01:51.489153 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a074d5c8-4f10-41d8-8ac1-fd3d9d532dfd None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:01:51.525320 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:01:51.541681 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:01:51.549572 dv-cinder-862365-1-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 313/642] 10.222.0.23 () {58 vars in 1024 bytes} [Fri Oct 28 19:01:51 2022] POST /identity/v3/auth/tokens => generated 1271 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 28 19:01:51.550929 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57782845-729d-4516-b459-726de63e5065 None None] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:01:51.551218 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57782845-729d-4516-b459-726de63e5065 None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:01:51.551492 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57782845-729d-4516-b459-726de63e5065 None None] PATH_INFO: `/` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:01:51.552836 dv-cinder-862365-1-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 314/643] 10.222.0.23 () {54 vars in 927 bytes} [Fri Oct 28 19:01:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 19:01:51.558580 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32cc9d7-7704-46e9-b999-466cdb212183 None None] REQUEST_METHOD: `POST` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:01:51.558976 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32cc9d7-7704-46e9-b999-466cdb212183 None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:01:51.559154 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32cc9d7-7704-46e9-b999-466cdb212183 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:01:51.578056 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.auth.core [None req-a32cc9d7-7704-46e9-b999-466cdb212183 None None] MFA Rules not processed for user `ae863915635746d1ac19970949de4722`. Rule list: `[]` (Enabled: `True`). {{(pid=81765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:01:51.579159 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-a32cc9d7-7704-46e9-b999-466cdb212183 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:01:51.615004 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a074d5c8-4f10-41d8-8ac1-fd3d9d532dfd None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:01:51.661522 dv-cinder-862365-1-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 315/644] 10.222.0.23 () {58 vars in 1024 bytes} [Fri Oct 28 19:01:51 2022] POST /identity/v3/auth/tokens => generated 1271 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 28 19:01:51.665248 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c5b6b6-24b3-4669-8ac3-f867c224d9b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:01:51.666100 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c5b6b6-24b3-4669-8ac3-f867c224d9b1 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:01:51.666560 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c5b6b6-24b3-4669-8ac3-f867c224d9b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:01:51.666973 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c5b6b6-24b3-4669-8ac3-f867c224d9b1 None admin] PATH_INFO: `/v3/services` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:01:51.667733 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c5b6b6-24b3-4669-8ac3-f867c224d9b1 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:01:51.668179 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c5b6b6-24b3-4669-8ac3-f867c224d9b1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:01:51.669703 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c5b6b6-24b3-4669-8ac3-f867c224d9b1 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:01:51.675430 dv-cinder-862365-1-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 330/645] 10.222.0.23 () {56 vars in 1114 bytes} [Fri Oct 28 19:01:51 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 19:01:51.683153 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32cc9d7-7704-46e9-b999-466cdb212183 None None] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:01:51.792158 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32cc9d7-7704-46e9-b999-466cdb212183 None None] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:01:51.820327 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:01:51.830132 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792ce87b-eb8b-4c8c-aee1-e645e6233687 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:01:51.830691 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792ce87b-eb8b-4c8c-aee1-e645e6233687 None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:01:51.830975 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792ce87b-eb8b-4c8c-aee1-e645e6233687 None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:01:51.831253 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792ce87b-eb8b-4c8c-aee1-e645e6233687 None admin] PATH_INFO: `/v3/services` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:01:51.831895 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-792ce87b-eb8b-4c8c-aee1-e645e6233687 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81765) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:01:51.832205 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-792ce87b-eb8b-4c8c-aee1-e645e6233687 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:01:51.833666 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-792ce87b-eb8b-4c8c-aee1-e645e6233687 None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:01:51.842483 dv-cinder-862365-1-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 316/646] 10.222.0.23 () {56 vars in 1114 bytes} [Fri Oct 28 19:01:51 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:01:51.846349 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c5b6b6-24b3-4669-8ac3-f867c224d9b1 None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:01:51.950299 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792ce87b-eb8b-4c8c-aee1-e645e6233687 None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:01:51.963319 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:01:51.968642 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c5b6b6-24b3-4669-8ac3-f867c224d9b1 None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:01:52.010746 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11dded1e-3e50-4107-a6f0-4ee0e770887d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:01:52.011963 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11dded1e-3e50-4107-a6f0-4ee0e770887d None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:01:52.012440 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11dded1e-3e50-4107-a6f0-4ee0e770887d None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:01:52.012929 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11dded1e-3e50-4107-a6f0-4ee0e770887d None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:01:52.013652 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11dded1e-3e50-4107-a6f0-4ee0e770887d None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:01:52.015802 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11dded1e-3e50-4107-a6f0-4ee0e770887d None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:01:52.034444 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application [None req-11dded1e-3e50-4107-a6f0-4ee0e770887d None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 28 19:01:52.034444 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 19:01:52.034444 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 28 19:01:52.034444 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 28 19:01:52.034444 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 28 19:01:52.034444 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 28 19:01:52.034444 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 28 19:01:52.034444 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 28 19:01:52.034444 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 28 19:01:52.034444 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Oct 28 19:01:52.034444 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 28 19:01:52.034444 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Oct 28 19:01:52.034444 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 19:01:52.034444 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 19:01:52.034444 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 19:01:52.034444 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 19:01:52.035623 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 19:01:52.035623 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 19:01:52.035623 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 19:01:52.035623 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 19:01:52.035623 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 19:01:52.035623 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 19:01:52.035623 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 19:01:52.035623 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 28 19:01:52.035623 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 28 19:01:52.035623 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 28 19:01:52.035623 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 28 19:01:52.035623 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 19:01:52.035623 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 19:01:52.035623 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 19:01:52.035623 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 19:01:52.035623 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 19:01:52.035623 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 19:01:52.036796 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 19:01:52.036796 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application with Lock( Oct 28 19:01:52.036796 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 19:01:52.036796 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._enter() Oct 28 19:01:52.036796 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 19:01:52.036796 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 19:01:52.036796 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 19:01:52.036796 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.creator() Oct 28 19:01:52.036796 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 19:01:52.036796 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application created_value = creator( Oct 28 19:01:52.036796 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 28 19:01:52.036796 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 28 19:01:52.036796 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 28 19:01:52.036796 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Oct 28 19:01:52.036796 dv-cinder-862365-1-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 331/647] 10.222.0.23 () {56 vars in 1132 bytes} [Fri Oct 28 19:01:51 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 19:01:52.042626 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11dded1e-3e50-4107-a6f0-4ee0e770887d None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:01:52.083578 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792ce87b-eb8b-4c8c-aee1-e645e6233687 None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:01:52.124153 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0f22ce-f56a-4528-9123-0c247b58ec5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:01:52.124904 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0f22ce-f56a-4528-9123-0c247b58ec5c None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:01:52.125184 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0f22ce-f56a-4528-9123-0c247b58ec5c None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:01:52.125480 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0f22ce-f56a-4528-9123-0c247b58ec5c None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:01:52.136089 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d0f22ce-f56a-4528-9123-0c247b58ec5c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 19:01:52.141070 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application [None req-9d0f22ce-f56a-4528-9123-0c247b58ec5c None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 28 19:01:52.141070 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 19:01:52.141070 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 19:01:52.141070 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 19:01:52.141070 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 19:01:52.141070 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 19:01:52.141070 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 19:01:52.141070 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 19:01:52.141070 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 19:01:52.141070 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 19:01:52.141070 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 19:01:52.141070 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 19:01:52.141070 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 28 19:01:52.141070 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 28 19:01:52.141070 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 28 19:01:52.141070 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 28 19:01:52.142107 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 28 19:01:52.142107 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 28 19:01:52.142107 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 28 19:01:52.142107 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 28 19:01:52.142107 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 19:01:52.142107 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 19:01:52.142107 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 19:01:52.142107 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 19:01:52.142107 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 19:01:52.142107 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 19:01:52.142107 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 19:01:52.142107 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application with Lock( Oct 28 19:01:52.142107 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 19:01:52.142107 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._enter() Oct 28 19:01:52.142107 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 19:01:52.142107 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 19:01:52.142944 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 19:01:52.142944 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.creator() Oct 28 19:01:52.142944 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 19:01:52.142944 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application created_value = creator( Oct 28 19:01:52.142944 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 28 19:01:52.142944 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 28 19:01:52.142944 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 28 19:01:52.142944 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 28 19:01:52.142944 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 28 19:01:52.142944 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 28 19:01:52.142944 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 28 19:01:52.142944 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application Oct 28 19:01:52.144701 dv-cinder-862365-1-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 317/648] 10.222.0.23 () {56 vars in 1120 bytes} [Fri Oct 28 19:01:51 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 28 19:01:52.145982 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d521aac-5099-4e24-b1b1-573c7e344417 None None] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:01:52.146272 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d521aac-5099-4e24-b1b1-573c7e344417 None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:01:52.146550 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d521aac-5099-4e24-b1b1-573c7e344417 None None] PATH_INFO: `/` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:01:52.148361 dv-cinder-862365-1-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 318/649] 10.222.0.23 () {54 vars in 927 bytes} [Fri Oct 28 19:01:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 19:01:52.149124 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d521aac-5099-4e24-b1b1-573c7e344417 None None] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:01:52.169786 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11dded1e-3e50-4107-a6f0-4ee0e770887d None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:01:52.205704 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed391d6-725b-4bd1-859e-a65458f0079f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:01:52.206320 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed391d6-725b-4bd1-859e-a65458f0079f None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:01:52.206598 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed391d6-725b-4bd1-859e-a65458f0079f None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:01:52.206870 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed391d6-725b-4bd1-859e-a65458f0079f None admin] PATH_INFO: `/v3/services` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:01:52.206968 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:01:52.207507 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed391d6-725b-4bd1-859e-a65458f0079f None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:01:52.207814 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed391d6-725b-4bd1-859e-a65458f0079f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:01:52.209205 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed391d6-725b-4bd1-859e-a65458f0079f None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:01:52.214708 dv-cinder-862365-1-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 332/650] 10.222.0.23 () {56 vars in 1126 bytes} [Fri Oct 28 19:01:52 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:01:52.215953 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4febdc07-7825-4671-9cdc-fc97cabb4b52 None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:01:52.216154 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4febdc07-7825-4671-9cdc-fc97cabb4b52 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:01:52.216425 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4febdc07-7825-4671-9cdc-fc97cabb4b52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:01:52.234781 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-4febdc07-7825-4671-9cdc-fc97cabb4b52 None None] MFA Rules not processed for user `ae863915635746d1ac19970949de4722`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:01:52.235962 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-4febdc07-7825-4671-9cdc-fc97cabb4b52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:01:52.256931 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:01:52.273538 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d521aac-5099-4e24-b1b1-573c7e344417 None None] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:01:52.310865 dv-cinder-862365-1-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 333/651] 10.222.0.23 () {58 vars in 1024 bytes} [Fri Oct 28 19:01:52 2022] POST /identity/v3/auth/tokens => generated 1271 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 28 19:01:52.311077 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801d694d-313c-43f3-8e23-b6c87db0e898 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:01:52.311649 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801d694d-313c-43f3-8e23-b6c87db0e898 None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:01:52.311933 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801d694d-313c-43f3-8e23-b6c87db0e898 None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:01:52.312209 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801d694d-313c-43f3-8e23-b6c87db0e898 None admin] PATH_INFO: `/v3/roles` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:01:52.312730 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4febdc07-7825-4671-9cdc-fc97cabb4b52 None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:01:52.312928 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801d694d-313c-43f3-8e23-b6c87db0e898 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81765) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:01:52.313239 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801d694d-313c-43f3-8e23-b6c87db0e898 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:01:52.314632 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801d694d-313c-43f3-8e23-b6c87db0e898 None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:01:52.330714 dv-cinder-862365-1-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 319/652] 10.222.0.23 () {56 vars in 1115 bytes} [Fri Oct 28 19:01:52 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:01:52.336026 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801d694d-313c-43f3-8e23-b6c87db0e898 None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:01:52.428223 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4febdc07-7825-4671-9cdc-fc97cabb4b52 None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:01:52.455365 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801d694d-313c-43f3-8e23-b6c87db0e898 None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:01:52.465342 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d248bd8-0e10-418a-9549-7507d5cdbd08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:01:52.466194 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d248bd8-0e10-418a-9549-7507d5cdbd08 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:01:52.466478 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d248bd8-0e10-418a-9549-7507d5cdbd08 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:01:52.466752 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d248bd8-0e10-418a-9549-7507d5cdbd08 None admin] PATH_INFO: `/v3/services` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:01:52.467385 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d248bd8-0e10-418a-9549-7507d5cdbd08 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:01:52.467689 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d248bd8-0e10-418a-9549-7507d5cdbd08 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:01:52.469167 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d248bd8-0e10-418a-9549-7507d5cdbd08 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:01:52.473222 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:01:52.475761 dv-cinder-862365-1-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 334/653] 10.222.0.23 () {56 vars in 1126 bytes} [Fri Oct 28 19:01:52 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:01:52.480979 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d248bd8-0e10-418a-9549-7507d5cdbd08 None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:01:52.497929 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2b33e5-9e7c-493e-b1aa-ea274b075ff8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:01:52.498559 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2b33e5-9e7c-493e-b1aa-ea274b075ff8 None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:01:52.498842 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2b33e5-9e7c-493e-b1aa-ea274b075ff8 None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:01:52.499116 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2b33e5-9e7c-493e-b1aa-ea274b075ff8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:01:52.505742 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:01:52.513578 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f2b33e5-9e7c-493e-b1aa-ea274b075ff8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:01:52.518784 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f2b33e5-9e7c-493e-b1aa-ea274b075ff8 None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:01:52.533057 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application [None req-1f2b33e5-9e7c-493e-b1aa-ea274b075ff8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 19:01:52.533057 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 19:01:52.533057 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 19:01:52.533057 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 19:01:52.533057 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 19:01:52.533057 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 19:01:52.533057 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 19:01:52.533057 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 19:01:52.533057 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 19:01:52.533057 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 19:01:52.533057 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 19:01:52.533057 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 19:01:52.533057 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 28 19:01:52.533057 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 28 19:01:52.533057 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 28 19:01:52.533057 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 28 19:01:52.534099 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 19:01:52.534099 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 19:01:52.534099 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 19:01:52.534099 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 19:01:52.534099 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 19:01:52.534099 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 19:01:52.534099 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 19:01:52.534099 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application with Lock( Oct 28 19:01:52.534099 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 19:01:52.534099 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._enter() Oct 28 19:01:52.534099 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 19:01:52.534099 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 19:01:52.534099 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 19:01:52.534099 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.creator() Oct 28 19:01:52.534099 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 19:01:52.534099 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application created_value = creator( Oct 28 19:01:52.534099 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 28 19:01:52.534999 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 28 19:01:52.534999 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 19:01:52.534999 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application Oct 28 19:01:52.542832 dv-cinder-862365-1-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 320/654] 10.222.0.23 () {56 vars in 1108 bytes} [Fri Oct 28 19:01:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 19:01:52.544332 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2b33e5-9e7c-493e-b1aa-ea274b075ff8 None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:01:52.599693 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d248bd8-0e10-418a-9549-7507d5cdbd08 None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:01:52.640897 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18d096e-c654-44b1-adbb-5a638cc65a86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:01:52.641835 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18d096e-c654-44b1-adbb-5a638cc65a86 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:01:52.642589 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18d096e-c654-44b1-adbb-5a638cc65a86 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:01:52.642870 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18d096e-c654-44b1-adbb-5a638cc65a86 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:01:52.643844 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18d096e-c654-44b1-adbb-5a638cc65a86 None admin] RBAC: Adding query filter params (interface=public, service_id=8d5523f1a1ab4513b71f209fafe213e2, region_id=RegionOne) {{(pid=81766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:01:52.644154 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18d096e-c654-44b1-adbb-5a638cc65a86 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:01:52.646226 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18d096e-c654-44b1-adbb-5a638cc65a86 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:01:52.657511 dv-cinder-862365-1-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 335/655] 10.222.0.23 () {56 vars in 1251 bytes} [Fri Oct 28 19:01:52 2022] GET /identity/v3/endpoints?service_id=8d5523f1a1ab4513b71f209fafe213e2&interface=public®ion_id=RegionOne => generated 194 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 19:01:52.658455 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18d096e-c654-44b1-adbb-5a638cc65a86 None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:01:52.665179 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2b33e5-9e7c-493e-b1aa-ea274b075ff8 None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:01:52.704262 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0296c159-0893-4210-bfab-6a03c28f04b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:01:52.704881 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0296c159-0893-4210-bfab-6a03c28f04b6 None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:01:52.705164 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0296c159-0893-4210-bfab-6a03c28f04b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:01:52.705474 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0296c159-0893-4210-bfab-6a03c28f04b6 None admin] PATH_INFO: `/v3/domains` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:01:52.706145 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0296c159-0893-4210-bfab-6a03c28f04b6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81765) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:01:52.706454 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0296c159-0893-4210-bfab-6a03c28f04b6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:01:52.707813 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0296c159-0893-4210-bfab-6a03c28f04b6 None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:01:52.720505 dv-cinder-862365-1-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 321/656] 10.222.0.23 () {56 vars in 1109 bytes} [Fri Oct 28 19:01:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:01:52.721165 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0296c159-0893-4210-bfab-6a03c28f04b6 None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:01:52.748252 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:01:52.755789 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:01:52.772212 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18d096e-c654-44b1-adbb-5a638cc65a86 None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:01:52.810822 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce9ef1e-4a92-497e-b046-660ba488e8c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:01:52.811464 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce9ef1e-4a92-497e-b046-660ba488e8c2 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:01:52.811745 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce9ef1e-4a92-497e-b046-660ba488e8c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:01:52.812164 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce9ef1e-4a92-497e-b046-660ba488e8c2 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:01:52.812711 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce9ef1e-4a92-497e-b046-660ba488e8c2 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:01:52.814115 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce9ef1e-4a92-497e-b046-660ba488e8c2 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:01:52.823551 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application [None req-1ce9ef1e-4a92-497e-b046-660ba488e8c2 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 28 19:01:52.823551 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 19:01:52.823551 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 28 19:01:52.823551 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 28 19:01:52.823551 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 28 19:01:52.823551 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 28 19:01:52.823551 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 28 19:01:52.823551 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 28 19:01:52.823551 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 28 19:01:52.823551 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Oct 28 19:01:52.823551 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 28 19:01:52.823551 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Oct 28 19:01:52.823551 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 19:01:52.823551 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 19:01:52.823551 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 19:01:52.823551 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 19:01:52.823551 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 19:01:52.824531 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 19:01:52.824531 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 19:01:52.824531 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 19:01:52.824531 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 19:01:52.824531 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 19:01:52.824531 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 19:01:52.824531 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 28 19:01:52.824531 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 28 19:01:52.824531 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 28 19:01:52.824531 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 28 19:01:52.824531 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 19:01:52.824531 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 19:01:52.824531 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 19:01:52.824531 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 19:01:52.824531 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 19:01:52.824531 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 19:01:52.825470 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 19:01:52.825470 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application with Lock( Oct 28 19:01:52.825470 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 19:01:52.825470 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._enter() Oct 28 19:01:52.825470 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 19:01:52.825470 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 19:01:52.825470 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 19:01:52.825470 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.creator() Oct 28 19:01:52.825470 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 19:01:52.825470 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application created_value = creator( Oct 28 19:01:52.825470 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 28 19:01:52.825470 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 28 19:01:52.825470 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 28 19:01:52.825470 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Oct 28 19:01:52.825470 dv-cinder-862365-1-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 336/657] 10.222.0.23 () {56 vars in 1126 bytes} [Fri Oct 28 19:01:52 2022] GET /identity/v3/services/object-store => generated 93 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 19:01:52.826877 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce9ef1e-4a92-497e-b046-660ba488e8c2 None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:01:52.835465 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0296c159-0893-4210-bfab-6a03c28f04b6 None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:01:52.872909 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed00048-96db-40d2-8da5-6c65ad18e3bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:01:52.873487 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed00048-96db-40d2-8da5-6c65ad18e3bb None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:01:52.873795 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed00048-96db-40d2-8da5-6c65ad18e3bb None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:01:52.874824 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed00048-96db-40d2-8da5-6c65ad18e3bb None admin] PATH_INFO: `/v3/services` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:01:52.875439 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed00048-96db-40d2-8da5-6c65ad18e3bb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:01:52.876804 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed00048-96db-40d2-8da5-6c65ad18e3bb None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:01:52.883108 dv-cinder-862365-1-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 322/658] 10.222.0.23 () {56 vars in 1087 bytes} [Fri Oct 28 19:01:52 2022] GET /identity/v3/services => generated 1029 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 19:01:52.885343 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed00048-96db-40d2-8da5-6c65ad18e3bb None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:01:52.986022 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce9ef1e-4a92-497e-b046-660ba488e8c2 None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:01:52.997540 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:01:53.011286 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed00048-96db-40d2-8da5-6c65ad18e3bb None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:01:53.036360 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22a5698-da32-4135-b824-c7bab039e948 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:01:53.037037 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22a5698-da32-4135-b824-c7bab039e948 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:01:53.037319 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22a5698-da32-4135-b824-c7bab039e948 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:01:53.037627 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22a5698-da32-4135-b824-c7bab039e948 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:01:53.046512 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22a5698-da32-4135-b824-c7bab039e948 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:01:53.047988 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22a5698-da32-4135-b824-c7bab039e948 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:01:53.058440 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d854fe-0f18-4aba-acd1-04da925a8cec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:01:53.059331 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d854fe-0f18-4aba-acd1-04da925a8cec None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:01:53.059766 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d854fe-0f18-4aba-acd1-04da925a8cec None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:01:53.060183 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d854fe-0f18-4aba-acd1-04da925a8cec None admin] PATH_INFO: `/v3/services` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:01:53.060961 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d854fe-0f18-4aba-acd1-04da925a8cec None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81765) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:01:53.061360 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application [None req-b22a5698-da32-4135-b824-c7bab039e948 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 28 19:01:53.061360 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 19:01:53.061360 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 19:01:53.061360 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 19:01:53.061360 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 19:01:53.061360 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 19:01:53.061360 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 19:01:53.061360 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 19:01:53.061360 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 19:01:53.061360 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 19:01:53.061360 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 19:01:53.061360 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 19:01:53.061360 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 28 19:01:53.061360 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 28 19:01:53.061360 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 28 19:01:53.061360 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 28 19:01:53.062314 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 19:01:53.062314 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 19:01:53.062314 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 28 19:01:53.062314 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 28 19:01:53.062314 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 28 19:01:53.062314 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 28 19:01:53.062314 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 19:01:53.062314 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 19:01:53.062314 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 19:01:53.062314 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 19:01:53.062314 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 19:01:53.062314 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application with Lock( Oct 28 19:01:53.062314 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 19:01:53.062314 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._enter() Oct 28 19:01:53.062314 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 19:01:53.062314 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 19:01:53.062314 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 19:01:53.062314 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.creator() Oct 28 19:01:53.063390 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 19:01:53.063390 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application created_value = creator( Oct 28 19:01:53.063390 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 28 19:01:53.063390 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 28 19:01:53.063390 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 28 19:01:53.063390 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 28 19:01:53.063390 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 28 19:01:53.063390 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 28 19:01:53.063390 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 28 19:01:53.063390 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Oct 28 19:01:53.063390 dv-cinder-862365-1-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 337/659] 10.222.0.23 () {56 vars in 1117 bytes} [Fri Oct 28 19:01:52 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 19:01:53.064277 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d854fe-0f18-4aba-acd1-04da925a8cec None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:01:53.065869 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d854fe-0f18-4aba-acd1-04da925a8cec None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:01:53.068079 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22a5698-da32-4135-b824-c7bab039e948 None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:01:53.073903 dv-cinder-862365-1-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 323/660] 10.222.0.23 () {56 vars in 1122 bytes} [Fri Oct 28 19:01:52 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:01:53.079843 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:01:53.080813 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d854fe-0f18-4aba-acd1-04da925a8cec None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:01:53.183248 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22a5698-da32-4135-b824-c7bab039e948 None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:01:53.195230 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d854fe-0f18-4aba-acd1-04da925a8cec None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:01:53.221371 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc37c15-67e1-45b5-9aed-7c5f7002b2d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:01:53.222228 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc37c15-67e1-45b5-9aed-7c5f7002b2d7 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:01:53.222690 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc37c15-67e1-45b5-9aed-7c5f7002b2d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:01:53.223063 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc37c15-67e1-45b5-9aed-7c5f7002b2d7 None admin] PATH_INFO: `/v3/users` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:01:53.223999 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc37c15-67e1-45b5-9aed-7c5f7002b2d7 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:01:53.224478 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc37c15-67e1-45b5-9aed-7c5f7002b2d7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:01:53.226143 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc37c15-67e1-45b5-9aed-7c5f7002b2d7 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:01:53.233227 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f736a5-b1f1-47e4-975e-eade78d199d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:01:53.233865 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f736a5-b1f1-47e4-975e-eade78d199d2 None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:01:53.234141 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f736a5-b1f1-47e4-975e-eade78d199d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:01:53.234419 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f736a5-b1f1-47e4-975e-eade78d199d2 None admin] PATH_INFO: `/v3/services` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:01:53.235043 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f736a5-b1f1-47e4-975e-eade78d199d2 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81765) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:01:53.235345 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f736a5-b1f1-47e4-975e-eade78d199d2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:01:53.236856 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f736a5-b1f1-47e4-975e-eade78d199d2 None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:01:53.242874 dv-cinder-862365-1-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 324/661] 10.222.0.23 () {56 vars in 1122 bytes} [Fri Oct 28 19:01:53 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:01:53.246972 dv-cinder-862365-1-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 338/662] 10.222.0.23 () {56 vars in 1149 bytes} [Fri Oct 28 19:01:53 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 19:01:53.254509 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f736a5-b1f1-47e4-975e-eade78d199d2 None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:01:53.276005 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:01:53.369630 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f736a5-b1f1-47e4-975e-eade78d199d2 None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:01:53.408335 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1310680d-ea20-4a96-8af5-8d0652aa923e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:01:53.409052 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1310680d-ea20-4a96-8af5-8d0652aa923e None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:01:53.409344 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1310680d-ea20-4a96-8af5-8d0652aa923e None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:01:53.409635 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1310680d-ea20-4a96-8af5-8d0652aa923e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:01:53.421136 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1310680d-ea20-4a96-8af5-8d0652aa923e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:01:53.422634 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1310680d-ea20-4a96-8af5-8d0652aa923e None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:01:53.439301 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application [None req-1310680d-ea20-4a96-8af5-8d0652aa923e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 19:01:53.439301 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 19:01:53.439301 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 19:01:53.439301 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 19:01:53.439301 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 19:01:53.439301 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 19:01:53.439301 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 19:01:53.439301 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 19:01:53.439301 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 19:01:53.439301 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 19:01:53.439301 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 19:01:53.439301 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 19:01:53.439301 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 28 19:01:53.439301 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 28 19:01:53.439301 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 28 19:01:53.439301 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 28 19:01:53.440255 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 19:01:53.440255 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 19:01:53.440255 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 19:01:53.440255 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 19:01:53.440255 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 19:01:53.440255 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 19:01:53.440255 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 19:01:53.440255 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application with Lock( Oct 28 19:01:53.440255 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 19:01:53.440255 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._enter() Oct 28 19:01:53.440255 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 19:01:53.440255 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 19:01:53.440255 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 19:01:53.440255 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.creator() Oct 28 19:01:53.440255 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 19:01:53.440255 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application created_value = creator( Oct 28 19:01:53.440255 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 28 19:01:53.441141 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 28 19:01:53.441141 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 19:01:53.441141 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application Oct 28 19:01:53.441752 dv-cinder-862365-1-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 325/663] 10.222.0.23 () {56 vars in 1108 bytes} [Fri Oct 28 19:01:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 19:01:53.448329 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc37c15-67e1-45b5-9aed-7c5f7002b2d7 None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:01:53.516083 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:01:53.550430 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc37c15-67e1-45b5-9aed-7c5f7002b2d7 None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:01:53.586559 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77adb007-0b1d-4446-bc34-bf1589e78c82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:01:53.587180 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77adb007-0b1d-4446-bc34-bf1589e78c82 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:01:53.587461 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77adb007-0b1d-4446-bc34-bf1589e78c82 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:01:53.587771 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77adb007-0b1d-4446-bc34-bf1589e78c82 None admin] PATH_INFO: `/v3/domains` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:01:53.588408 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77adb007-0b1d-4446-bc34-bf1589e78c82 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:01:53.588711 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77adb007-0b1d-4446-bc34-bf1589e78c82 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:01:53.590095 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77adb007-0b1d-4446-bc34-bf1589e78c82 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:01:53.602177 dv-cinder-862365-1-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 339/664] 10.222.0.23 () {56 vars in 1109 bytes} [Fri Oct 28 19:01:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:01:53.608250 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1310680d-ea20-4a96-8af5-8d0652aa923e None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:01:53.677730 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:01:53.712337 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1310680d-ea20-4a96-8af5-8d0652aa923e None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:01:53.747979 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379038b9-f975-423d-95b5-5432286e49cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:01:53.748615 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379038b9-f975-423d-95b5-5432286e49cc None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:01:53.748946 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379038b9-f975-423d-95b5-5432286e49cc None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:01:53.749224 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379038b9-f975-423d-95b5-5432286e49cc None admin] PATH_INFO: `/v3/projects/service` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:01:53.756243 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379038b9-f975-423d-95b5-5432286e49cc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:01:53.757860 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379038b9-f975-423d-95b5-5432286e49cc None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:01:53.772459 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application [None req-379038b9-f975-423d-95b5-5432286e49cc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 28 19:01:53.772459 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 19:01:53.772459 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 19:01:53.772459 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 19:01:53.772459 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 19:01:53.772459 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 19:01:53.772459 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 19:01:53.772459 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 19:01:53.772459 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 19:01:53.772459 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 19:01:53.772459 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 19:01:53.772459 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 19:01:53.772459 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 28 19:01:53.772459 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 28 19:01:53.772459 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 28 19:01:53.773755 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 28 19:01:53.773755 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 19:01:53.773755 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 19:01:53.773755 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 19:01:53.773755 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 19:01:53.773755 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 19:01:53.773755 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 19:01:53.773755 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 19:01:53.773755 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application with Lock( Oct 28 19:01:53.773755 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 19:01:53.773755 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._enter() Oct 28 19:01:53.773755 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 19:01:53.773755 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 19:01:53.773755 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 19:01:53.773755 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.creator() Oct 28 19:01:53.773755 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 19:01:53.773755 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application created_value = creator( Oct 28 19:01:53.774859 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 28 19:01:53.774859 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 28 19:01:53.774859 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 28 19:01:53.774859 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 28 19:01:53.774859 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 28 19:01:53.774859 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 28 19:01:53.774859 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 28 19:01:53.774859 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application Oct 28 19:01:53.777403 dv-cinder-862365-1-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 326/665] 10.222.0.23 () {56 vars in 1111 bytes} [Fri Oct 28 19:01:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 19:01:53.783322 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77adb007-0b1d-4446-bc34-bf1589e78c82 None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:01:53.894224 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77adb007-0b1d-4446-bc34-bf1589e78c82 None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:01:53.924730 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:01:53.933166 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9a89db-a569-40e8-bad9-5a2f71fbe62c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:01:53.933800 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9a89db-a569-40e8-bad9-5a2f71fbe62c None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:01:53.934080 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9a89db-a569-40e8-bad9-5a2f71fbe62c None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:01:53.934411 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9a89db-a569-40e8-bad9-5a2f71fbe62c None admin] PATH_INFO: `/v3/projects` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:01:53.935088 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9a89db-a569-40e8-bad9-5a2f71fbe62c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:01:53.935392 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9a89db-a569-40e8-bad9-5a2f71fbe62c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:01:53.936816 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9a89db-a569-40e8-bad9-5a2f71fbe62c None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:01:53.949181 dv-cinder-862365-1-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 340/666] 10.222.0.23 () {56 vars in 1148 bytes} [Fri Oct 28 19:01:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:01:53.955136 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379038b9-f975-423d-95b5-5432286e49cc None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:01:54.069567 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379038b9-f975-423d-95b5-5432286e49cc None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:01:54.109685 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d184bcc-c5a8-4ef2-9c66-0ba39a715166 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:01:54.110771 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d184bcc-c5a8-4ef2-9c66-0ba39a715166 None admin] REQUEST_METHOD: `PUT` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:01:54.111271 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d184bcc-c5a8-4ef2-9c66-0ba39a715166 None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:01:54.111787 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d184bcc-c5a8-4ef2-9c66-0ba39a715166 None admin] PATH_INFO: `/v3/projects/b705897907f042c0818a931052438e1e/users/820bee57d7dc4c5a962107e97f050835/roles/2250592f6f214a5d8bf3c0a36c04f738` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:01:54.114217 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d184bcc-c5a8-4ef2-9c66-0ba39a715166 None admin] RBAC: Authorizing `identity:create_grant(project_id=b705897907f042c0818a931052438e1e, user_id=820bee57d7dc4c5a962107e97f050835, role_id=2250592f6f214a5d8bf3c0a36c04f738)` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:01:54.115940 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d184bcc-c5a8-4ef2-9c66-0ba39a715166 None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:01:54.120990 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:01:54.179308 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1414fc86-34cc-47ad-a8af-74f84d99cfcb None None] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:01:54.179857 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1414fc86-34cc-47ad-a8af-74f84d99cfcb None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:01:54.179857 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1414fc86-34cc-47ad-a8af-74f84d99cfcb None None] PATH_INFO: `/` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:01:54.181322 dv-cinder-862365-1-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 341/667] 10.222.0.23 () {54 vars in 927 bytes} [Fri Oct 28 19:01:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 19:01:54.186513 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693d5f1e-c6e5-4f61-bda0-a36cef8a76a5 None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:01:54.186802 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693d5f1e-c6e5-4f61-bda0-a36cef8a76a5 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:01:54.187082 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693d5f1e-c6e5-4f61-bda0-a36cef8a76a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:01:54.204162 dv-cinder-862365-1-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 327/668] 10.222.0.23 () {58 vars in 1439 bytes} [Fri Oct 28 19:01:53 2022] PUT /identity/v3/projects/b705897907f042c0818a931052438e1e/users/820bee57d7dc4c5a962107e97f050835/roles/2250592f6f214a5d8bf3c0a36c04f738 => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 19:01:54.211164 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-693d5f1e-c6e5-4f61-bda0-a36cef8a76a5 None None] MFA Rules not processed for user `ae863915635746d1ac19970949de4722`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:01:54.212651 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-693d5f1e-c6e5-4f61-bda0-a36cef8a76a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:01:54.301382 dv-cinder-862365-1-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 342/669] 10.222.0.23 () {58 vars in 1024 bytes} [Fri Oct 28 19:01:54 2022] POST /identity/v3/auth/tokens => generated 1271 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 28 19:01:54.571520 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d184bcc-c5a8-4ef2-9c66-0ba39a715166 None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:01:54.678423 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d184bcc-c5a8-4ef2-9c66-0ba39a715166 None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:01:54.714315 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c89c6b5-0515-4c0b-b481-5cbff4f4cef1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:01:54.714929 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c89c6b5-0515-4c0b-b481-5cbff4f4cef1 None admin] REQUEST_METHOD: `POST` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:01:54.715208 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c89c6b5-0515-4c0b-b481-5cbff4f4cef1 None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:01:54.715481 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c89c6b5-0515-4c0b-b481-5cbff4f4cef1 None admin] PATH_INFO: `/v3/services` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:01:54.716140 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c89c6b5-0515-4c0b-b481-5cbff4f4cef1 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:01:54.717535 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c89c6b5-0515-4c0b-b481-5cbff4f4cef1 None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:01:54.808026 dv-cinder-862365-1-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 328/670] 10.222.0.23 () {60 vars in 1141 bytes} [Fri Oct 28 19:01:54 2022] POST /identity/v3/services => generated 251 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 19:01:55.239703 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b109a5b3-2d52-430b-b1b3-da265c1e6849 None None] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:01:55.240199 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b109a5b3-2d52-430b-b1b3-da265c1e6849 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:01:55.240199 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b109a5b3-2d52-430b-b1b3-da265c1e6849 None None] PATH_INFO: `/` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:01:55.241854 dv-cinder-862365-1-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 343/671] 10.222.0.23 () {54 vars in 927 bytes} [Fri Oct 28 19:01:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 19:01:55.247711 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0024f1e-2f5b-4c16-98cf-89604e73866f None None] REQUEST_METHOD: `POST` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:01:55.248135 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0024f1e-2f5b-4c16-98cf-89604e73866f None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:01:55.248296 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0024f1e-2f5b-4c16-98cf-89604e73866f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:01:55.267103 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.auth.core [None req-c0024f1e-2f5b-4c16-98cf-89604e73866f None None] MFA Rules not processed for user `ae863915635746d1ac19970949de4722`. Rule list: `[]` (Enabled: `True`). {{(pid=81765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:01:55.268293 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-c0024f1e-2f5b-4c16-98cf-89604e73866f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:01:55.312903 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:01:55.347247 dv-cinder-862365-1-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 329/672] 10.222.0.23 () {58 vars in 1024 bytes} [Fri Oct 28 19:01:55 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 28 19:01:55.622120 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b109a5b3-2d52-430b-b1b3-da265c1e6849 None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:01:55.668318 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b7405c-ef46-44c8-b5cb-07e6b3399de2 None None] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:01:55.668751 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b7405c-ef46-44c8-b5cb-07e6b3399de2 None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:01:55.669130 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b7405c-ef46-44c8-b5cb-07e6b3399de2 None None] PATH_INFO: `/` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:01:55.675912 dv-cinder-862365-1-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 330/673] 10.222.0.23 () {54 vars in 927 bytes} [Fri Oct 28 19:01:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 19:01:55.680336 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b443b3-00be-4a95-8312-5908657bbbbb None None] REQUEST_METHOD: `POST` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:01:55.680630 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b443b3-00be-4a95-8312-5908657bbbbb None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:01:55.680913 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b443b3-00be-4a95-8312-5908657bbbbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:01:55.702382 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.auth.core [None req-23b443b3-00be-4a95-8312-5908657bbbbb None None] MFA Rules not processed for user `ae863915635746d1ac19970949de4722`. Rule list: `[]` (Enabled: `True`). {{(pid=81765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:01:55.703556 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-23b443b3-00be-4a95-8312-5908657bbbbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:01:55.742291 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b109a5b3-2d52-430b-b1b3-da265c1e6849 None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:01:55.768044 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:01:55.784183 dv-cinder-862365-1-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 331/674] 10.222.0.23 () {58 vars in 1024 bytes} [Fri Oct 28 19:01:55 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 28 19:01:55.791869 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff71661-a74e-4061-8bd5-2772801a1072 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:01:55.792498 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff71661-a74e-4061-8bd5-2772801a1072 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:01:55.792775 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff71661-a74e-4061-8bd5-2772801a1072 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:01:55.793099 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff71661-a74e-4061-8bd5-2772801a1072 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:01:55.793861 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff71661-a74e-4061-8bd5-2772801a1072 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:01:55.795253 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff71661-a74e-4061-8bd5-2772801a1072 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:01:55.804353 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application [None req-4ff71661-a74e-4061-8bd5-2772801a1072 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 28 19:01:55.804353 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 19:01:55.804353 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 28 19:01:55.804353 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 28 19:01:55.804353 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 28 19:01:55.804353 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 28 19:01:55.804353 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 28 19:01:55.804353 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 28 19:01:55.804353 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 28 19:01:55.804353 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Oct 28 19:01:55.804353 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 28 19:01:55.804353 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Oct 28 19:01:55.804353 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 19:01:55.804353 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 19:01:55.804353 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 19:01:55.804353 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 19:01:55.805306 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 19:01:55.805306 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 19:01:55.805306 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 19:01:55.805306 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 19:01:55.805306 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 19:01:55.805306 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 19:01:55.805306 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 19:01:55.805306 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 28 19:01:55.805306 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 28 19:01:55.805306 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 28 19:01:55.805306 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 28 19:01:55.805306 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 19:01:55.805306 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 19:01:55.805306 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 19:01:55.805306 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 19:01:55.805306 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 19:01:55.805306 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 19:01:55.806651 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 19:01:55.806651 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application with Lock( Oct 28 19:01:55.806651 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 19:01:55.806651 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._enter() Oct 28 19:01:55.806651 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 19:01:55.806651 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 19:01:55.806651 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 19:01:55.806651 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.creator() Oct 28 19:01:55.806651 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 19:01:55.806651 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application created_value = creator( Oct 28 19:01:55.806651 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 28 19:01:55.806651 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 28 19:01:55.806651 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 28 19:01:55.806651 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Oct 28 19:01:55.806651 dv-cinder-862365-1-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 344/675] 10.222.0.23 () {56 vars in 1132 bytes} [Fri Oct 28 19:01:55 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 19:01:55.814406 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b443b3-00be-4a95-8312-5908657bbbbb None None] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:01:55.932708 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b443b3-00be-4a95-8312-5908657bbbbb None None] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:01:55.935060 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:01:55.967945 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a9cca4-8e4d-4f68-9574-d03074c47a78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:01:55.968553 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a9cca4-8e4d-4f68-9574-d03074c47a78 None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:01:55.968839 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a9cca4-8e4d-4f68-9574-d03074c47a78 None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:01:55.969109 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a9cca4-8e4d-4f68-9574-d03074c47a78 None admin] PATH_INFO: `/v3/services` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:01:55.969766 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a9cca4-8e4d-4f68-9574-d03074c47a78 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81765) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:01:55.970071 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a9cca4-8e4d-4f68-9574-d03074c47a78 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:01:55.971439 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a9cca4-8e4d-4f68-9574-d03074c47a78 None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:01:55.976635 dv-cinder-862365-1-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 332/676] 10.222.0.23 () {56 vars in 1126 bytes} [Fri Oct 28 19:01:55 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:01:55.983414 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff71661-a74e-4061-8bd5-2772801a1072 None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:01:56.062184 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a9cca4-8e4d-4f68-9574-d03074c47a78 None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:01:56.098038 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff71661-a74e-4061-8bd5-2772801a1072 None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:01:56.133842 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e4696d-a7ce-42ad-bb73-2cd3716bc2c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:01:56.134456 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e4696d-a7ce-42ad-bb73-2cd3716bc2c5 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:01:56.134739 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e4696d-a7ce-42ad-bb73-2cd3716bc2c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:01:56.135110 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e4696d-a7ce-42ad-bb73-2cd3716bc2c5 None admin] PATH_INFO: `/v3/services` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:01:56.135747 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e4696d-a7ce-42ad-bb73-2cd3716bc2c5 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:01:56.136051 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e4696d-a7ce-42ad-bb73-2cd3716bc2c5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:01:56.137434 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e4696d-a7ce-42ad-bb73-2cd3716bc2c5 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:01:56.143221 dv-cinder-862365-1-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 345/677] 10.222.0.23 () {56 vars in 1126 bytes} [Fri Oct 28 19:01:55 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:01:56.149025 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e4696d-a7ce-42ad-bb73-2cd3716bc2c5 None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:01:56.192404 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a9cca4-8e4d-4f68-9574-d03074c47a78 None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:01:56.200980 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:01:56.232259 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f09ff2-61fe-46f7-a0fe-54ce88d601f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:01:56.233241 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f09ff2-61fe-46f7-a0fe-54ce88d601f8 None admin] REQUEST_METHOD: `POST` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:01:56.233809 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f09ff2-61fe-46f7-a0fe-54ce88d601f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:01:56.234280 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f09ff2-61fe-46f7-a0fe-54ce88d601f8 None admin] PATH_INFO: `/v3/services` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:01:56.235137 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f09ff2-61fe-46f7-a0fe-54ce88d601f8 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:01:56.236700 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f09ff2-61fe-46f7-a0fe-54ce88d601f8 None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:01:56.256628 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e4696d-a7ce-42ad-bb73-2cd3716bc2c5 None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:01:56.291425 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07bc2c47-8333-4df7-afe2-268a0b5f0de1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:01:56.292030 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bc2c47-8333-4df7-afe2-268a0b5f0de1 None admin] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:01:56.292305 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bc2c47-8333-4df7-afe2-268a0b5f0de1 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:01:56.292571 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bc2c47-8333-4df7-afe2-268a0b5f0de1 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:01:56.293220 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07bc2c47-8333-4df7-afe2-268a0b5f0de1 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:01:56.294600 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07bc2c47-8333-4df7-afe2-268a0b5f0de1 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:01:56.302144 dv-cinder-862365-1-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 333/678] 10.222.0.23 () {60 vars in 1141 bytes} [Fri Oct 28 19:01:56 2022] POST /identity/v3/services => generated 241 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 28 19:01:56.393865 dv-cinder-862365-1-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 346/679] 10.222.0.23 () {60 vars in 1144 bytes} [Fri Oct 28 19:01:56 2022] POST /identity/v3/endpoints => generated 347 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 28 19:01:56.560754 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34d4afb-e4a9-4ba8-aa8d-1df4f206c1d8 None None] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:01:56.561316 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34d4afb-e4a9-4ba8-aa8d-1df4f206c1d8 None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:01:56.561806 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34d4afb-e4a9-4ba8-aa8d-1df4f206c1d8 None None] PATH_INFO: `/` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:01:56.563705 dv-cinder-862365-1-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 334/680] 10.222.0.23 () {54 vars in 927 bytes} [Fri Oct 28 19:01:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 19:01:56.569677 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda29842-c9de-4a33-b4b0-8df5c421194f None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:01:56.570259 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda29842-c9de-4a33-b4b0-8df5c421194f None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:01:56.570753 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda29842-c9de-4a33-b4b0-8df5c421194f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:01:56.593335 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-fda29842-c9de-4a33-b4b0-8df5c421194f None None] MFA Rules not processed for user `ae863915635746d1ac19970949de4722`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:01:56.593335 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-fda29842-c9de-4a33-b4b0-8df5c421194f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:01:56.672662 dv-cinder-862365-1-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 347/681] 10.222.0.23 () {58 vars in 1024 bytes} [Fri Oct 28 19:01:56 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 28 19:01:56.956777 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34d4afb-e4a9-4ba8-aa8d-1df4f206c1d8 None None] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:01:56.987613 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:01:57.058317 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a6005c-1676-4b24-8836-5f1d39a5181b None None] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:01:57.058638 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a6005c-1676-4b24-8836-5f1d39a5181b None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:01:57.058872 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a6005c-1676-4b24-8836-5f1d39a5181b None None] PATH_INFO: `/` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:01:57.060444 dv-cinder-862365-1-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 348/682] 10.222.0.23 () {54 vars in 927 bytes} [Fri Oct 28 19:01:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 19:01:57.065652 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db307371-7852-4d4e-8fe0-8bf1c1b65942 None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:01:57.065941 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db307371-7852-4d4e-8fe0-8bf1c1b65942 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:01:57.066219 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db307371-7852-4d4e-8fe0-8bf1c1b65942 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:01:57.069492 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34d4afb-e4a9-4ba8-aa8d-1df4f206c1d8 None None] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:01:57.092777 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-db307371-7852-4d4e-8fe0-8bf1c1b65942 None None] MFA Rules not processed for user `ae863915635746d1ac19970949de4722`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:01:57.094589 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-db307371-7852-4d4e-8fe0-8bf1c1b65942 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:01:57.111838 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86de99aa-609a-41a5-a13c-5f26931cdcac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:01:57.112479 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86de99aa-609a-41a5-a13c-5f26931cdcac None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:01:57.112760 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86de99aa-609a-41a5-a13c-5f26931cdcac None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:01:57.113038 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86de99aa-609a-41a5-a13c-5f26931cdcac None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:01:57.119205 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:01:57.123888 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86de99aa-609a-41a5-a13c-5f26931cdcac None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 19:01:57.129321 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application [None req-86de99aa-609a-41a5-a13c-5f26931cdcac None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 28 19:01:57.129321 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 19:01:57.129321 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 19:01:57.129321 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 19:01:57.129321 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 19:01:57.129321 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 19:01:57.129321 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 19:01:57.129321 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 19:01:57.129321 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 19:01:57.129321 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 19:01:57.129321 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 19:01:57.129321 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 19:01:57.129321 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 28 19:01:57.129321 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 28 19:01:57.129321 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 28 19:01:57.129321 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 28 19:01:57.130285 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 28 19:01:57.130285 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 28 19:01:57.130285 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 28 19:01:57.130285 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 28 19:01:57.130285 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 19:01:57.130285 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 19:01:57.130285 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 19:01:57.130285 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 19:01:57.130285 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 19:01:57.130285 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 19:01:57.130285 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 19:01:57.130285 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application with Lock( Oct 28 19:01:57.130285 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 19:01:57.130285 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._enter() Oct 28 19:01:57.130285 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 19:01:57.130285 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 19:01:57.131168 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 19:01:57.131168 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.creator() Oct 28 19:01:57.131168 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 19:01:57.131168 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application created_value = creator( Oct 28 19:01:57.131168 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 28 19:01:57.131168 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 28 19:01:57.131168 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 28 19:01:57.131168 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 28 19:01:57.131168 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 28 19:01:57.131168 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 28 19:01:57.131168 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 28 19:01:57.131168 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application Oct 28 19:01:57.131168 dv-cinder-862365-1-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 335/683] 10.222.0.23 () {56 vars in 1120 bytes} [Fri Oct 28 19:01:56 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 19:01:57.137036 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86de99aa-609a-41a5-a13c-5f26931cdcac None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:01:57.177798 dv-cinder-862365-1-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 349/684] 10.222.0.23 () {58 vars in 1024 bytes} [Fri Oct 28 19:01:57 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 28 19:01:57.236161 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:01:57.249505 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86de99aa-609a-41a5-a13c-5f26931cdcac None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:01:57.286352 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6ad376-d72a-47ea-aee0-cd960003f19c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:01:57.286969 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6ad376-d72a-47ea-aee0-cd960003f19c None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:01:57.287252 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6ad376-d72a-47ea-aee0-cd960003f19c None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:01:57.287525 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6ad376-d72a-47ea-aee0-cd960003f19c None admin] PATH_INFO: `/v3/roles` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:01:57.288185 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6ad376-d72a-47ea-aee0-cd960003f19c None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81765) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:01:57.288490 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6ad376-d72a-47ea-aee0-cd960003f19c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:01:57.289881 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6ad376-d72a-47ea-aee0-cd960003f19c None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:01:57.302929 dv-cinder-862365-1-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 336/685] 10.222.0.23 () {56 vars in 1115 bytes} [Fri Oct 28 19:01:57 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:01:57.305571 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db307371-7852-4d4e-8fe0-8bf1c1b65942 None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:01:57.414475 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db307371-7852-4d4e-8fe0-8bf1c1b65942 None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:01:57.449570 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6ad376-d72a-47ea-aee0-cd960003f19c None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:01:57.450971 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03be158d-8066-4f9c-ac0a-fa2cf1482992 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:01:57.451839 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03be158d-8066-4f9c-ac0a-fa2cf1482992 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:01:57.452347 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03be158d-8066-4f9c-ac0a-fa2cf1482992 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:01:57.452625 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03be158d-8066-4f9c-ac0a-fa2cf1482992 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:01:57.463997 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03be158d-8066-4f9c-ac0a-fa2cf1482992 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:01:57.465464 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03be158d-8066-4f9c-ac0a-fa2cf1482992 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:01:57.485995 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application [None req-03be158d-8066-4f9c-ac0a-fa2cf1482992 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 19:01:57.485995 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 19:01:57.485995 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 19:01:57.485995 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 19:01:57.485995 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 19:01:57.485995 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 19:01:57.485995 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 19:01:57.485995 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 19:01:57.485995 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 19:01:57.485995 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 19:01:57.485995 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 19:01:57.485995 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 19:01:57.485995 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 28 19:01:57.485995 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 28 19:01:57.485995 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 28 19:01:57.485995 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 28 19:01:57.486969 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 19:01:57.486969 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 19:01:57.486969 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 19:01:57.486969 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 19:01:57.486969 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 19:01:57.486969 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 19:01:57.486969 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 19:01:57.486969 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application with Lock( Oct 28 19:01:57.486969 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 19:01:57.486969 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._enter() Oct 28 19:01:57.486969 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 19:01:57.486969 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 19:01:57.486969 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 19:01:57.486969 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.creator() Oct 28 19:01:57.486969 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 19:01:57.486969 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application created_value = creator( Oct 28 19:01:57.486969 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 28 19:01:57.487863 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 28 19:01:57.487863 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 19:01:57.487863 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Oct 28 19:01:57.487863 dv-cinder-862365-1-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 350/686] 10.222.0.23 () {56 vars in 1108 bytes} [Fri Oct 28 19:01:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 19:01:57.495637 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03be158d-8066-4f9c-ac0a-fa2cf1482992 None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:01:57.506664 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:01:57.568116 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6ad376-d72a-47ea-aee0-cd960003f19c None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:01:57.602351 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03be158d-8066-4f9c-ac0a-fa2cf1482992 None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:01:57.606801 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8fbea8-11c1-4f39-aa79-9edf672508c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:01:57.607697 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8fbea8-11c1-4f39-aa79-9edf672508c8 None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:01:57.608180 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8fbea8-11c1-4f39-aa79-9edf672508c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:01:57.608685 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8fbea8-11c1-4f39-aa79-9edf672508c8 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:01:57.609500 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8fbea8-11c1-4f39-aa79-9edf672508c8 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:01:57.611199 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8fbea8-11c1-4f39-aa79-9edf672508c8 None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:01:57.622705 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application [None req-5e8fbea8-11c1-4f39-aa79-9edf672508c8 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 28 19:01:57.622705 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 19:01:57.622705 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 28 19:01:57.622705 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 28 19:01:57.622705 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 28 19:01:57.622705 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 28 19:01:57.622705 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 28 19:01:57.622705 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 28 19:01:57.622705 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 28 19:01:57.622705 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application Oct 28 19:01:57.622705 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 28 19:01:57.622705 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application Oct 28 19:01:57.622705 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 19:01:57.622705 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 19:01:57.622705 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 19:01:57.622705 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 19:01:57.622705 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 19:01:57.623718 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 19:01:57.623718 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 19:01:57.623718 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 19:01:57.623718 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 19:01:57.623718 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 19:01:57.623718 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 19:01:57.623718 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 28 19:01:57.623718 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 28 19:01:57.623718 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 28 19:01:57.623718 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 28 19:01:57.623718 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 19:01:57.623718 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 19:01:57.623718 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 19:01:57.623718 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 19:01:57.623718 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 19:01:57.623718 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 19:01:57.624539 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 19:01:57.624539 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application with Lock( Oct 28 19:01:57.624539 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 19:01:57.624539 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._enter() Oct 28 19:01:57.624539 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 19:01:57.624539 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 19:01:57.624539 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 19:01:57.624539 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.creator() Oct 28 19:01:57.624539 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 19:01:57.624539 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application created_value = creator( Oct 28 19:01:57.624539 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 28 19:01:57.624539 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 28 19:01:57.624539 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 28 19:01:57.624539 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application Oct 28 19:01:57.632307 dv-cinder-862365-1-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 337/687] 10.222.0.23 () {56 vars in 1114 bytes} [Fri Oct 28 19:01:57 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 19:01:57.633192 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8fbea8-11c1-4f39-aa79-9edf672508c8 None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:01:57.641258 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be02f920-fab5-485a-8286-57f2e18f3d66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:01:57.642186 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be02f920-fab5-485a-8286-57f2e18f3d66 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:01:57.642688 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be02f920-fab5-485a-8286-57f2e18f3d66 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:01:57.643288 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be02f920-fab5-485a-8286-57f2e18f3d66 None admin] PATH_INFO: `/v3/domains` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:01:57.644172 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be02f920-fab5-485a-8286-57f2e18f3d66 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:01:57.644683 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be02f920-fab5-485a-8286-57f2e18f3d66 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:01:57.646388 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be02f920-fab5-485a-8286-57f2e18f3d66 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:01:57.650585 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:01:57.661212 dv-cinder-862365-1-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 351/688] 10.222.0.23 () {56 vars in 1109 bytes} [Fri Oct 28 19:01:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:01:57.666512 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be02f920-fab5-485a-8286-57f2e18f3d66 None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:01:57.740620 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8fbea8-11c1-4f39-aa79-9edf672508c8 None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:01:57.741747 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:01:57.777903 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be02f920-fab5-485a-8286-57f2e18f3d66 None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:01:57.778697 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d122b0ac-8180-47f8-ac4f-63c9151e1cbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:01:57.779309 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d122b0ac-8180-47f8-ac4f-63c9151e1cbe None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:01:57.780277 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d122b0ac-8180-47f8-ac4f-63c9151e1cbe None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:01:57.780558 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d122b0ac-8180-47f8-ac4f-63c9151e1cbe None admin] PATH_INFO: `/v3/services` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:01:57.781300 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d122b0ac-8180-47f8-ac4f-63c9151e1cbe None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81765) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:01:57.781642 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d122b0ac-8180-47f8-ac4f-63c9151e1cbe None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:01:57.783014 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d122b0ac-8180-47f8-ac4f-63c9151e1cbe None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:01:57.792909 dv-cinder-862365-1-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 338/689] 10.222.0.23 () {56 vars in 1114 bytes} [Fri Oct 28 19:01:57 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:01:57.794071 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d122b0ac-8180-47f8-ac4f-63c9151e1cbe None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:01:57.815526 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33506d6d-debe-45ef-88f4-513788ccf514 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:01:57.816264 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33506d6d-debe-45ef-88f4-513788ccf514 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:01:57.816549 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33506d6d-debe-45ef-88f4-513788ccf514 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:01:57.816822 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33506d6d-debe-45ef-88f4-513788ccf514 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:01:57.826530 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33506d6d-debe-45ef-88f4-513788ccf514 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:01:57.828024 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33506d6d-debe-45ef-88f4-513788ccf514 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:01:57.840966 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application [None req-33506d6d-debe-45ef-88f4-513788ccf514 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 28 19:01:57.840966 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 19:01:57.840966 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 19:01:57.840966 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 19:01:57.840966 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 19:01:57.840966 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 19:01:57.840966 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 19:01:57.840966 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 19:01:57.840966 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 19:01:57.840966 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 19:01:57.840966 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 19:01:57.840966 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 19:01:57.840966 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 28 19:01:57.840966 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 28 19:01:57.840966 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 28 19:01:57.840966 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 28 19:01:57.850144 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 19:01:57.850144 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 19:01:57.850144 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 28 19:01:57.850144 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 28 19:01:57.850144 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 28 19:01:57.850144 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 28 19:01:57.850144 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 19:01:57.850144 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 19:01:57.850144 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 19:01:57.850144 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 19:01:57.850144 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 19:01:57.850144 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application with Lock( Oct 28 19:01:57.850144 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 19:01:57.850144 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._enter() Oct 28 19:01:57.850144 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 19:01:57.850144 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 19:01:57.850144 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 19:01:57.850144 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.creator() Oct 28 19:01:57.851960 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 19:01:57.851960 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application created_value = creator( Oct 28 19:01:57.851960 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 28 19:01:57.851960 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 28 19:01:57.851960 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 28 19:01:57.851960 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 28 19:01:57.851960 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 28 19:01:57.851960 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 28 19:01:57.851960 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 28 19:01:57.851960 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Oct 28 19:01:57.851960 dv-cinder-862365-1-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 352/690] 10.222.0.23 () {56 vars in 1117 bytes} [Fri Oct 28 19:01:57 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 28 19:01:57.855473 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33506d6d-debe-45ef-88f4-513788ccf514 None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:01:57.885780 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:01:57.910343 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d122b0ac-8180-47f8-ac4f-63c9151e1cbe None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:01:57.954439 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5597fc8b-d1e8-459b-9157-cf618e8ffdff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:01:57.955179 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5597fc8b-d1e8-459b-9157-cf618e8ffdff None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:01:57.955534 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5597fc8b-d1e8-459b-9157-cf618e8ffdff None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:01:57.955935 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5597fc8b-d1e8-459b-9157-cf618e8ffdff None admin] PATH_INFO: `/v3/services` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:01:57.956668 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5597fc8b-d1e8-459b-9157-cf618e8ffdff None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81765) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:01:57.956980 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5597fc8b-d1e8-459b-9157-cf618e8ffdff None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:01:57.958382 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5597fc8b-d1e8-459b-9157-cf618e8ffdff None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:01:57.966203 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33506d6d-debe-45ef-88f4-513788ccf514 None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:01:57.969449 dv-cinder-862365-1-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 339/691] 10.222.0.23 () {56 vars in 1114 bytes} [Fri Oct 28 19:01:57 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:01:57.970638 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5597fc8b-d1e8-459b-9157-cf618e8ffdff None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:01:58.004576 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:01:58.015579 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723cec5b-31ef-4ea8-91f6-e7f94cb33004 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:01:58.017039 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723cec5b-31ef-4ea8-91f6-e7f94cb33004 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:01:58.017553 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723cec5b-31ef-4ea8-91f6-e7f94cb33004 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:01:58.018485 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723cec5b-31ef-4ea8-91f6-e7f94cb33004 None admin] PATH_INFO: `/v3/users` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:01:58.019793 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723cec5b-31ef-4ea8-91f6-e7f94cb33004 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:01:58.020497 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723cec5b-31ef-4ea8-91f6-e7f94cb33004 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:01:58.022274 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723cec5b-31ef-4ea8-91f6-e7f94cb33004 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:01:58.046211 dv-cinder-862365-1-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 353/692] 10.222.0.23 () {56 vars in 1149 bytes} [Fri Oct 28 19:01:57 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:01:58.051842 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723cec5b-31ef-4ea8-91f6-e7f94cb33004 None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:01:58.086805 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5597fc8b-d1e8-459b-9157-cf618e8ffdff None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:01:58.141450 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7fd018-3db9-43f2-a3c1-b502bfc54390 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:01:58.142457 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7fd018-3db9-43f2-a3c1-b502bfc54390 None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:01:58.143464 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7fd018-3db9-43f2-a3c1-b502bfc54390 None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:01:58.143966 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7fd018-3db9-43f2-a3c1-b502bfc54390 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:01:58.144891 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7fd018-3db9-43f2-a3c1-b502bfc54390 None admin] RBAC: Adding query filter params (interface=public, service_id=939dfc9ebbbc4e8e8f57369a6278e210, region_id=RegionOne) {{(pid=81765) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:01:58.145843 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7fd018-3db9-43f2-a3c1-b502bfc54390 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:01:58.148126 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7fd018-3db9-43f2-a3c1-b502bfc54390 None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:01:58.160592 dv-cinder-862365-1-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 340/693] 10.222.0.23 () {56 vars in 1251 bytes} [Fri Oct 28 19:01:57 2022] GET /identity/v3/endpoints?service_id=939dfc9ebbbc4e8e8f57369a6278e210&interface=public®ion_id=RegionOne => generated 194 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 19:01:58.161037 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7fd018-3db9-43f2-a3c1-b502bfc54390 None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:01:58.174188 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:01:58.174643 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723cec5b-31ef-4ea8-91f6-e7f94cb33004 None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:01:58.215751 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f30c17a-b600-4a21-a55e-6edaa1cec59c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:01:58.216286 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f30c17a-b600-4a21-a55e-6edaa1cec59c None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:01:58.216562 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f30c17a-b600-4a21-a55e-6edaa1cec59c None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:01:58.216832 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f30c17a-b600-4a21-a55e-6edaa1cec59c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:01:58.278777 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:01:58.292956 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f30c17a-b600-4a21-a55e-6edaa1cec59c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:01:58.294442 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f30c17a-b600-4a21-a55e-6edaa1cec59c None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:01:58.303195 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7fd018-3db9-43f2-a3c1-b502bfc54390 None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:01:58.351574 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85d3e47-52f0-4bba-9cb5-a9549a74b4ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:01:58.352810 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85d3e47-52f0-4bba-9cb5-a9549a74b4ab None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:01:58.354087 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85d3e47-52f0-4bba-9cb5-a9549a74b4ab None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:01:58.354377 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85d3e47-52f0-4bba-9cb5-a9549a74b4ab None admin] PATH_INFO: `/v3/services` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:01:58.354991 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b85d3e47-52f0-4bba-9cb5-a9549a74b4ab None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:01:58.356405 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b85d3e47-52f0-4bba-9cb5-a9549a74b4ab None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:01:58.373891 dv-cinder-862365-1-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 341/694] 10.222.0.23 () {56 vars in 1087 bytes} [Fri Oct 28 19:01:58 2022] GET /identity/v3/services => generated 1497 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 28 19:01:58.418740 dv-cinder-862365-1-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 354/695] 10.222.0.23 () {58 vars in 1282 bytes} [Fri Oct 28 19:01:58 2022] GET /identity/v3/auth/tokens => generated 1474 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 28 19:01:58.426506 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85d3e47-52f0-4bba-9cb5-a9549a74b4ab None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:01:58.497117 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0ac5f5-f4bd-447a-bc82-bb69e681464e None None] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:01:58.497426 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0ac5f5-f4bd-447a-bc82-bb69e681464e None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:01:58.497700 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0ac5f5-f4bd-447a-bc82-bb69e681464e None None] PATH_INFO: `/` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:01:58.499330 dv-cinder-862365-1-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 355/696] 10.222.0.23 () {54 vars in 927 bytes} [Fri Oct 28 19:01:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 19:01:58.504994 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01cda1b-4101-47a4-8582-8f0e389d6a3f None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:01:58.505269 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01cda1b-4101-47a4-8582-8f0e389d6a3f None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:01:58.505580 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01cda1b-4101-47a4-8582-8f0e389d6a3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:01:58.507100 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:01:58.524880 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-d01cda1b-4101-47a4-8582-8f0e389d6a3f None None] MFA Rules not processed for user `ae863915635746d1ac19970949de4722`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:01:58.526680 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-d01cda1b-4101-47a4-8582-8f0e389d6a3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:01:58.543678 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85d3e47-52f0-4bba-9cb5-a9549a74b4ab None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:01:58.590713 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e318d3b-059f-41f3-962c-f9819e07662e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:01:58.591647 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e318d3b-059f-41f3-962c-f9819e07662e None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:01:58.591933 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e318d3b-059f-41f3-962c-f9819e07662e None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:01:58.592463 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e318d3b-059f-41f3-962c-f9819e07662e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:01:58.605252 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e318d3b-059f-41f3-962c-f9819e07662e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:01:58.606819 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e318d3b-059f-41f3-962c-f9819e07662e None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:01:58.614236 dv-cinder-862365-1-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 356/697] 10.222.0.23 () {58 vars in 1024 bytes} [Fri Oct 28 19:01:58 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 28 19:01:58.630061 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application [None req-1e318d3b-059f-41f3-962c-f9819e07662e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 19:01:58.630061 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 19:01:58.630061 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 19:01:58.630061 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 19:01:58.630061 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 19:01:58.630061 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 19:01:58.630061 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 19:01:58.630061 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 19:01:58.630061 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 19:01:58.630061 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 19:01:58.630061 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 19:01:58.630061 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 19:01:58.630061 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 28 19:01:58.630061 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 28 19:01:58.630061 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 28 19:01:58.630061 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 28 19:01:58.634941 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 19:01:58.634941 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 19:01:58.634941 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 19:01:58.634941 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 19:01:58.634941 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 19:01:58.634941 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 19:01:58.634941 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 19:01:58.634941 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application with Lock( Oct 28 19:01:58.634941 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 19:01:58.634941 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._enter() Oct 28 19:01:58.634941 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 19:01:58.634941 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 19:01:58.634941 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 19:01:58.634941 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.creator() Oct 28 19:01:58.634941 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 19:01:58.634941 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application created_value = creator( Oct 28 19:01:58.634941 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 28 19:01:58.636081 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 28 19:01:58.636081 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 19:01:58.636081 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application Oct 28 19:01:58.636081 dv-cinder-862365-1-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 342/698] 10.222.0.23 () {56 vars in 1108 bytes} [Fri Oct 28 19:01:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 19:01:58.639308 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01cda1b-4101-47a4-8582-8f0e389d6a3f None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:01:58.661007 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:01:58.753038 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01cda1b-4101-47a4-8582-8f0e389d6a3f None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:01:58.775823 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3ab82e-e20a-4846-8793-3d44fdd4021c None None] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:01:58.778378 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3ab82e-e20a-4846-8793-3d44fdd4021c None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:01:58.778378 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3ab82e-e20a-4846-8793-3d44fdd4021c None None] PATH_INFO: `/` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:01:58.778378 dv-cinder-862365-1-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 343/699] 10.222.0.23 () {54 vars in 927 bytes} [Fri Oct 28 19:01:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 28 19:01:58.782875 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1037403-2772-4706-845f-1113d1c6839a None None] REQUEST_METHOD: `POST` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:01:58.783156 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1037403-2772-4706-845f-1113d1c6839a None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:01:58.783428 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1037403-2772-4706-845f-1113d1c6839a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:01:58.788582 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3686a8d0-0597-4a17-a3c9-3f88beef5174 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:01:58.789228 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3686a8d0-0597-4a17-a3c9-3f88beef5174 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:01:58.789547 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3686a8d0-0597-4a17-a3c9-3f88beef5174 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:01:58.789894 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3686a8d0-0597-4a17-a3c9-3f88beef5174 None admin] PATH_INFO: `/v3/domains` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:01:58.790527 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3686a8d0-0597-4a17-a3c9-3f88beef5174 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:01:58.791380 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3686a8d0-0597-4a17-a3c9-3f88beef5174 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:01:58.792745 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3686a8d0-0597-4a17-a3c9-3f88beef5174 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:01:58.802325 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.auth.core [None req-c1037403-2772-4706-845f-1113d1c6839a None None] MFA Rules not processed for user `ae863915635746d1ac19970949de4722`. Rule list: `[]` (Enabled: `True`). {{(pid=81765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:01:58.803507 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-c1037403-2772-4706-845f-1113d1c6839a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:01:58.804871 dv-cinder-862365-1-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 357/700] 10.222.0.23 () {56 vars in 1109 bytes} [Fri Oct 28 19:01:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 19:01:58.812801 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3686a8d0-0597-4a17-a3c9-3f88beef5174 None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:01:58.887980 dv-cinder-862365-1-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 344/701] 10.222.0.23 () {58 vars in 1024 bytes} [Fri Oct 28 19:01:58 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 28 19:01:58.895277 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1037403-2772-4706-845f-1113d1c6839a None None] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:01:58.913717 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:01:58.944427 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3686a8d0-0597-4a17-a3c9-3f88beef5174 None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:01:58.966333 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:01:58.990381 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3d610b-76df-4878-8abc-ec9819b4320f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:01:58.991016 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3d610b-76df-4878-8abc-ec9819b4320f None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:01:58.991295 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3d610b-76df-4878-8abc-ec9819b4320f None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:01:58.991569 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3d610b-76df-4878-8abc-ec9819b4320f None admin] PATH_INFO: `/v3/projects/service` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:01:59.001275 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3d610b-76df-4878-8abc-ec9819b4320f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:01:59.003831 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3d610b-76df-4878-8abc-ec9819b4320f None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:01:59.019979 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application [None req-ac3d610b-76df-4878-8abc-ec9819b4320f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 28 19:01:59.019979 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 19:01:59.019979 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 19:01:59.019979 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 19:01:59.019979 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 19:01:59.019979 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 19:01:59.019979 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 19:01:59.019979 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 19:01:59.019979 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 19:01:59.019979 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 19:01:59.019979 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 19:01:59.019979 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 19:01:59.019979 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 28 19:01:59.019979 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 28 19:01:59.019979 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 28 19:01:59.020862 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 28 19:01:59.020862 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 19:01:59.020862 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 19:01:59.020862 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 19:01:59.020862 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 19:01:59.020862 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 19:01:59.020862 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 19:01:59.020862 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 19:01:59.020862 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application with Lock( Oct 28 19:01:59.020862 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 19:01:59.020862 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._enter() Oct 28 19:01:59.020862 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 19:01:59.020862 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 19:01:59.020862 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 19:01:59.020862 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.creator() Oct 28 19:01:59.020862 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 19:01:59.020862 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application created_value = creator( Oct 28 19:01:59.021791 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 28 19:01:59.021791 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 28 19:01:59.021791 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 28 19:01:59.021791 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 28 19:01:59.021791 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 28 19:01:59.021791 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 28 19:01:59.021791 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 28 19:01:59.021791 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Oct 28 19:01:59.022217 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1037403-2772-4706-845f-1113d1c6839a None None] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:01:59.022291 dv-cinder-862365-1-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 358/702] 10.222.0.23 () {56 vars in 1111 bytes} [Fri Oct 28 19:01:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 19:01:59.027632 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3d610b-76df-4878-8abc-ec9819b4320f None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:01:59.071473 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe22e5d-22f7-4254-a3fe-0aa0262f056b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:01:59.072626 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe22e5d-22f7-4254-a3fe-0aa0262f056b None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:01:59.072915 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe22e5d-22f7-4254-a3fe-0aa0262f056b None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:01:59.073193 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe22e5d-22f7-4254-a3fe-0aa0262f056b None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:01:59.074283 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe22e5d-22f7-4254-a3fe-0aa0262f056b None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:01:59.075974 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe22e5d-22f7-4254-a3fe-0aa0262f056b None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:01:59.087465 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application [None req-6fe22e5d-22f7-4254-a3fe-0aa0262f056b None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 28 19:01:59.087465 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 19:01:59.087465 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 28 19:01:59.087465 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 28 19:01:59.087465 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 28 19:01:59.087465 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 28 19:01:59.087465 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 28 19:01:59.087465 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 28 19:01:59.087465 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 28 19:01:59.087465 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application Oct 28 19:01:59.087465 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 28 19:01:59.087465 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application Oct 28 19:01:59.087465 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 19:01:59.087465 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 19:01:59.087465 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 19:01:59.087465 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 19:01:59.087465 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 19:01:59.089688 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 19:01:59.089688 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 19:01:59.089688 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 19:01:59.089688 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 19:01:59.089688 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 19:01:59.089688 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 19:01:59.089688 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 28 19:01:59.089688 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 28 19:01:59.089688 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 28 19:01:59.089688 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 28 19:01:59.089688 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 19:01:59.089688 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 19:01:59.089688 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 19:01:59.089688 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 19:01:59.089688 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 19:01:59.089688 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 19:01:59.091598 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 19:01:59.091598 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application with Lock( Oct 28 19:01:59.091598 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 19:01:59.091598 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._enter() Oct 28 19:01:59.091598 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 19:01:59.091598 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 19:01:59.091598 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 19:01:59.091598 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.creator() Oct 28 19:01:59.091598 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 19:01:59.091598 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application created_value = creator( Oct 28 19:01:59.091598 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 28 19:01:59.091598 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 28 19:01:59.091598 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 28 19:01:59.091598 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application Oct 28 19:01:59.091598 dv-cinder-862365-1-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 345/703] 10.222.0.23 () {56 vars in 1126 bytes} [Fri Oct 28 19:01:58 2022] GET /identity/v3/services/object-store => generated 93 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 28 19:01:59.099045 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe22e5d-22f7-4254-a3fe-0aa0262f056b None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:01:59.136603 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3d610b-76df-4878-8abc-ec9819b4320f None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:01:59.172660 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab598ee3-3ee7-4792-a6e2-0d92c600a588 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:01:59.173266 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab598ee3-3ee7-4792-a6e2-0d92c600a588 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:01:59.173581 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab598ee3-3ee7-4792-a6e2-0d92c600a588 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:01:59.173856 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab598ee3-3ee7-4792-a6e2-0d92c600a588 None admin] PATH_INFO: `/v3/projects` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:01:59.174529 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab598ee3-3ee7-4792-a6e2-0d92c600a588 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:01:59.174833 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab598ee3-3ee7-4792-a6e2-0d92c600a588 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:01:59.176244 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab598ee3-3ee7-4792-a6e2-0d92c600a588 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:01:59.178831 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:01:59.189170 dv-cinder-862365-1-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 359/704] 10.222.0.23 () {56 vars in 1148 bytes} [Fri Oct 28 19:01:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 19:01:59.190079 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab598ee3-3ee7-4792-a6e2-0d92c600a588 None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:01:59.206945 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe22e5d-22f7-4254-a3fe-0aa0262f056b None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:01:59.224603 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:01:59.243894 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fccd3a4e-915e-439c-91b8-0aff8d582957 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:01:59.244504 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccd3a4e-915e-439c-91b8-0aff8d582957 None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:01:59.244783 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccd3a4e-915e-439c-91b8-0aff8d582957 None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:01:59.245053 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccd3a4e-915e-439c-91b8-0aff8d582957 None admin] PATH_INFO: `/v3/services` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:01:59.245829 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fccd3a4e-915e-439c-91b8-0aff8d582957 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81765) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:01:59.246253 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fccd3a4e-915e-439c-91b8-0aff8d582957 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:01:59.247613 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fccd3a4e-915e-439c-91b8-0aff8d582957 None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:01:59.253237 dv-cinder-862365-1-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 346/705] 10.222.0.23 () {56 vars in 1122 bytes} [Fri Oct 28 19:01:59 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 19:01:59.254600 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fccd3a4e-915e-439c-91b8-0aff8d582957 None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:01:59.294906 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab598ee3-3ee7-4792-a6e2-0d92c600a588 None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:01:59.331886 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8d80b1-d2cb-49b0-97ca-1b0d500d3034 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:01:59.332516 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8d80b1-d2cb-49b0-97ca-1b0d500d3034 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:01:59.332797 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8d80b1-d2cb-49b0-97ca-1b0d500d3034 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:01:59.333070 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8d80b1-d2cb-49b0-97ca-1b0d500d3034 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:01:59.333688 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8d80b1-d2cb-49b0-97ca-1b0d500d3034 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:01:59.335479 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8d80b1-d2cb-49b0-97ca-1b0d500d3034 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:01:59.347655 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application [None req-8f8d80b1-d2cb-49b0-97ca-1b0d500d3034 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Oct 28 19:01:59.347655 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 19:01:59.347655 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 28 19:01:59.347655 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 28 19:01:59.347655 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 28 19:01:59.347655 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 28 19:01:59.347655 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 28 19:01:59.347655 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 28 19:01:59.347655 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Oct 28 19:01:59.347655 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Oct 28 19:01:59.347655 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 28 19:01:59.347655 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Oct 28 19:01:59.347655 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 19:01:59.347655 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 19:01:59.347655 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 19:01:59.347655 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 19:01:59.347655 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 19:01:59.348645 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 19:01:59.348645 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 19:01:59.348645 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 19:01:59.348645 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 19:01:59.348645 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 19:01:59.348645 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 19:01:59.348645 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 28 19:01:59.348645 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 28 19:01:59.348645 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 28 19:01:59.348645 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 28 19:01:59.348645 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 19:01:59.348645 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 19:01:59.348645 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 19:01:59.348645 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 19:01:59.348645 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 19:01:59.348645 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 19:01:59.349917 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 19:01:59.349917 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application with Lock( Oct 28 19:01:59.349917 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 19:01:59.349917 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._enter() Oct 28 19:01:59.349917 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 19:01:59.349917 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 19:01:59.349917 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 19:01:59.349917 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.creator() Oct 28 19:01:59.349917 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 19:01:59.349917 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application created_value = creator( Oct 28 19:01:59.349917 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 28 19:01:59.349917 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 28 19:01:59.349917 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Oct 28 19:01:59.349917 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Oct 28 19:01:59.349917 dv-cinder-862365-1-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 360/706] 10.222.0.23 () {56 vars in 1111 bytes} [Fri Oct 28 19:01:59 2022] GET /identity/v3/services/compute => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 19:01:59.350759 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8d80b1-d2cb-49b0-97ca-1b0d500d3034 None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:01:59.366769 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fccd3a4e-915e-439c-91b8-0aff8d582957 None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:01:59.403914 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e0003d-ec33-4c56-a433-4a3c42eef9c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:01:59.404546 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e0003d-ec33-4c56-a433-4a3c42eef9c3 None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:01:59.404827 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e0003d-ec33-4c56-a433-4a3c42eef9c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:01:59.405103 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e0003d-ec33-4c56-a433-4a3c42eef9c3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:01:59.405881 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e0003d-ec33-4c56-a433-4a3c42eef9c3 None admin] RBAC: Adding query filter params (role.id=2250592f6f214a5d8bf3c0a36c04f738, scope.project.id=b705897907f042c0818a931052438e1e, user.id=820bee57d7dc4c5a962107e97f050835) {{(pid=81765) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:01:59.406193 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e0003d-ec33-4c56-a433-4a3c42eef9c3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:01:59.407690 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e0003d-ec33-4c56-a433-4a3c42eef9c3 None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:01:59.421381 dv-cinder-862365-1-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 347/707] 10.222.0.23 () {56 vars in 1374 bytes} [Fri Oct 28 19:01:59 2022] GET /identity/v3/role_assignments?user.id=820bee57d7dc4c5a962107e97f050835&scope.project.id=b705897907f042c0818a931052438e1e&role.id=2250592f6f214a5d8bf3c0a36c04f738 => generated 608 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:01:59.421381 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e0003d-ec33-4c56-a433-4a3c42eef9c3 None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:01:59.422336 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:01:59.464028 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8d80b1-d2cb-49b0-97ca-1b0d500d3034 None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:01:59.507628 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19aeec76-9c3e-49c4-8231-a07314955b7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:01:59.508287 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:01:59.508469 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19aeec76-9c3e-49c4-8231-a07314955b7b None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:01:59.508727 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19aeec76-9c3e-49c4-8231-a07314955b7b None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:01:59.509005 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19aeec76-9c3e-49c4-8231-a07314955b7b None admin] PATH_INFO: `/v3/services` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:01:59.509893 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19aeec76-9c3e-49c4-8231-a07314955b7b None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:01:59.510201 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19aeec76-9c3e-49c4-8231-a07314955b7b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:01:59.512601 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19aeec76-9c3e-49c4-8231-a07314955b7b None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:01:59.519730 dv-cinder-862365-1-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 361/708] 10.222.0.23 () {56 vars in 1122 bytes} [Fri Oct 28 19:01:59 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:01:59.525588 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19aeec76-9c3e-49c4-8231-a07314955b7b None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:01:59.549822 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e0003d-ec33-4c56-a433-4a3c42eef9c3 None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:01:59.593787 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbe8337-a56e-46c2-9b0f-fd5451fd1cf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:01:59.594570 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbe8337-a56e-46c2-9b0f-fd5451fd1cf6 None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:01:59.594951 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbe8337-a56e-46c2-9b0f-fd5451fd1cf6 None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:01:59.595347 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbe8337-a56e-46c2-9b0f-fd5451fd1cf6 None admin] PATH_INFO: `/v3/services` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:01:59.596090 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fbe8337-a56e-46c2-9b0f-fd5451fd1cf6 None admin] RBAC: Adding query filter params (name=compute) {{(pid=81765) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:01:59.596496 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fbe8337-a56e-46c2-9b0f-fd5451fd1cf6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:01:59.598074 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fbe8337-a56e-46c2-9b0f-fd5451fd1cf6 None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:01:59.605255 dv-cinder-862365-1-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 348/709] 10.222.0.23 () {56 vars in 1112 bytes} [Fri Oct 28 19:01:59 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:01:59.618418 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbe8337-a56e-46c2-9b0f-fd5451fd1cf6 None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:01:59.650343 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19aeec76-9c3e-49c4-8231-a07314955b7b None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:01:59.680005 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:01:59.692321 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f55f0e-ba4d-4cd0-a793-1da682d29f8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:01:59.692930 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f55f0e-ba4d-4cd0-a793-1da682d29f8f None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:01:59.693210 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f55f0e-ba4d-4cd0-a793-1da682d29f8f None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:01:59.693949 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f55f0e-ba4d-4cd0-a793-1da682d29f8f None admin] PATH_INFO: `/v3/endpoints` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:01:59.694798 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f55f0e-ba4d-4cd0-a793-1da682d29f8f None admin] RBAC: Adding query filter params (interface=public, service_id=d8c15e0c03e3437da3943b3ba75544ba, region_id=RegionOne) {{(pid=81766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:01:59.695232 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f55f0e-ba4d-4cd0-a793-1da682d29f8f None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:01:59.696777 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f55f0e-ba4d-4cd0-a793-1da682d29f8f None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:01:59.703945 dv-cinder-862365-1-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 362/710] 10.222.0.23 () {56 vars in 1251 bytes} [Fri Oct 28 19:01:59 2022] GET /identity/v3/endpoints?service_id=d8c15e0c03e3437da3943b3ba75544ba&interface=public®ion_id=RegionOne => generated 194 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:01:59.709606 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f55f0e-ba4d-4cd0-a793-1da682d29f8f None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:01:59.749141 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbe8337-a56e-46c2-9b0f-fd5451fd1cf6 None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:01:59.759448 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:01:59.790577 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f628a61-2119-4f03-b396-23f8c6d88869 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:01:59.791746 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f628a61-2119-4f03-b396-23f8c6d88869 None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:01:59.792027 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f628a61-2119-4f03-b396-23f8c6d88869 None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:01:59.792316 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f628a61-2119-4f03-b396-23f8c6d88869 None admin] PATH_INFO: `/v3/services` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:01:59.792937 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f628a61-2119-4f03-b396-23f8c6d88869 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81765) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:01:59.793243 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f628a61-2119-4f03-b396-23f8c6d88869 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:01:59.794675 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f628a61-2119-4f03-b396-23f8c6d88869 None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:01:59.808172 dv-cinder-862365-1-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 349/711] 10.222.0.23 () {56 vars in 1112 bytes} [Fri Oct 28 19:01:59 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:01:59.836816 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f55f0e-ba4d-4cd0-a793-1da682d29f8f None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:01:59.877453 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6083833b-af75-4584-bb3f-753dea3b4552 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:01:59.878133 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6083833b-af75-4584-bb3f-753dea3b4552 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:01:59.878420 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6083833b-af75-4584-bb3f-753dea3b4552 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:01:59.878851 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6083833b-af75-4584-bb3f-753dea3b4552 None admin] PATH_INFO: `/v3/services` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:01:59.879472 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6083833b-af75-4584-bb3f-753dea3b4552 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:01:59.880901 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6083833b-af75-4584-bb3f-753dea3b4552 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:01:59.888528 dv-cinder-862365-1-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 363/712] 10.222.0.23 () {56 vars in 1087 bytes} [Fri Oct 28 19:01:59 2022] GET /identity/v3/services => generated 1497 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 19:02:00.709690 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fc8084-2bc5-4769-91f1-10aaf1e8495f None None] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:02:00.710225 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fc8084-2bc5-4769-91f1-10aaf1e8495f None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:02:00.710225 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fc8084-2bc5-4769-91f1-10aaf1e8495f None None] PATH_INFO: `/` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:02:00.712140 dv-cinder-862365-1-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 350/713] 10.222.0.23 () {54 vars in 927 bytes} [Fri Oct 28 19:02:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 19:02:00.718094 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273bd0e0-2430-42c3-916d-a5574ad9ed0c None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:02:00.718513 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273bd0e0-2430-42c3-916d-a5574ad9ed0c None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:02:00.718689 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273bd0e0-2430-42c3-916d-a5574ad9ed0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:02:00.738637 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-273bd0e0-2430-42c3-916d-a5574ad9ed0c None None] MFA Rules not processed for user `ae863915635746d1ac19970949de4722`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:02:00.739881 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-273bd0e0-2430-42c3-916d-a5574ad9ed0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:02:00.790544 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:02:00.817465 dv-cinder-862365-1-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 364/714] 10.222.0.23 () {58 vars in 1024 bytes} [Fri Oct 28 19:02:00 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 28 19:02:01.088842 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42fc8084-2bc5-4769-91f1-10aaf1e8495f None None] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:02:01.195331 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42fc8084-2bc5-4769-91f1-10aaf1e8495f None None] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:02:01.231247 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff47be8-a161-44fd-b0b7-1244a190522c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:02:01.231882 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff47be8-a161-44fd-b0b7-1244a190522c None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:02:01.232164 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff47be8-a161-44fd-b0b7-1244a190522c None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:02:01.232447 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff47be8-a161-44fd-b0b7-1244a190522c None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:02:01.233028 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff47be8-a161-44fd-b0b7-1244a190522c None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:02:01.234507 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff47be8-a161-44fd-b0b7-1244a190522c None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:02:01.243482 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application [None req-3ff47be8-a161-44fd-b0b7-1244a190522c None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 28 19:02:01.243482 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 19:02:01.243482 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 28 19:02:01.243482 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 28 19:02:01.243482 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 28 19:02:01.243482 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 28 19:02:01.243482 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 28 19:02:01.243482 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 28 19:02:01.243482 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 28 19:02:01.243482 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application Oct 28 19:02:01.243482 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 28 19:02:01.243482 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application Oct 28 19:02:01.243482 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 19:02:01.243482 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 19:02:01.243482 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 19:02:01.243482 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 19:02:01.243482 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 19:02:01.245077 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 19:02:01.245077 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 19:02:01.245077 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 19:02:01.245077 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 19:02:01.245077 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 19:02:01.245077 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 19:02:01.245077 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 28 19:02:01.245077 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 28 19:02:01.245077 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 28 19:02:01.245077 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 28 19:02:01.245077 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 19:02:01.245077 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 19:02:01.245077 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 19:02:01.245077 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 19:02:01.245077 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 19:02:01.245077 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 19:02:01.245948 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 19:02:01.245948 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application with Lock( Oct 28 19:02:01.245948 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 19:02:01.245948 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._enter() Oct 28 19:02:01.245948 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 19:02:01.245948 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 19:02:01.245948 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 19:02:01.245948 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.creator() Oct 28 19:02:01.245948 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 19:02:01.245948 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application created_value = creator( Oct 28 19:02:01.245948 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 28 19:02:01.245948 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 28 19:02:01.245948 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 28 19:02:01.245948 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application Oct 28 19:02:01.249483 dv-cinder-862365-1-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 351/715] 10.222.0.23 () {56 vars in 1114 bytes} [Fri Oct 28 19:02:01 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 19:02:01.251448 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273bd0e0-2430-42c3-916d-a5574ad9ed0c None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:02:01.357222 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273bd0e0-2430-42c3-916d-a5574ad9ed0c None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:02:01.392689 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a2b4d5-9b85-4008-8905-d42cc4eaf554 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:02:01.393743 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a2b4d5-9b85-4008-8905-d42cc4eaf554 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:02:01.394220 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a2b4d5-9b85-4008-8905-d42cc4eaf554 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:02:01.394684 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a2b4d5-9b85-4008-8905-d42cc4eaf554 None admin] PATH_INFO: `/v3/services` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:02:01.395496 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a2b4d5-9b85-4008-8905-d42cc4eaf554 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:02:01.396121 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a2b4d5-9b85-4008-8905-d42cc4eaf554 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:02:01.397701 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a2b4d5-9b85-4008-8905-d42cc4eaf554 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:02:01.403441 dv-cinder-862365-1-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 365/716] 10.222.0.23 () {56 vars in 1114 bytes} [Fri Oct 28 19:02:01 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:02:01.412621 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff47be8-a161-44fd-b0b7-1244a190522c None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:02:01.446302 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:02:01.518281 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff47be8-a161-44fd-b0b7-1244a190522c None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:02:01.554398 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1f6e7b-ef10-43b9-8c1d-7682b9d32369 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:02:01.555009 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1f6e7b-ef10-43b9-8c1d-7682b9d32369 None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:02:01.555290 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1f6e7b-ef10-43b9-8c1d-7682b9d32369 None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:02:01.555564 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1f6e7b-ef10-43b9-8c1d-7682b9d32369 None admin] PATH_INFO: `/v3/services` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:02:01.556190 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1f6e7b-ef10-43b9-8c1d-7682b9d32369 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81765) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:02:01.556561 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1f6e7b-ef10-43b9-8c1d-7682b9d32369 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:02:01.557962 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1f6e7b-ef10-43b9-8c1d-7682b9d32369 None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:02:01.563247 dv-cinder-862365-1-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 352/717] 10.222.0.23 () {56 vars in 1114 bytes} [Fri Oct 28 19:02:01 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:02:01.568845 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a2b4d5-9b85-4008-8905-d42cc4eaf554 None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:02:01.623075 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:02:01.681332 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a2b4d5-9b85-4008-8905-d42cc4eaf554 None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:02:01.714217 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6db93e-6bae-4d43-b2f5-7c6776b55c27 None None] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:02:01.715163 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6db93e-6bae-4d43-b2f5-7c6776b55c27 None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:02:01.715800 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6db93e-6bae-4d43-b2f5-7c6776b55c27 None None] PATH_INFO: `/` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:02:01.717724 dv-cinder-862365-1-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 353/718] 10.222.0.23 () {54 vars in 927 bytes} [Fri Oct 28 19:02:01 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 19:02:01.719583 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ffb5396-036c-41d4-b237-f1f47461a792 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:02:01.720698 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffb5396-036c-41d4-b237-f1f47461a792 None admin] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:02:01.721303 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffb5396-036c-41d4-b237-f1f47461a792 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:02:01.721810 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffb5396-036c-41d4-b237-f1f47461a792 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:02:01.722565 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9903aacd-f6a3-4035-a105-81a76b69340f None None] REQUEST_METHOD: `POST` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:02:01.722855 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9903aacd-f6a3-4035-a105-81a76b69340f None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:02:01.723107 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ffb5396-036c-41d4-b237-f1f47461a792 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:02:01.723206 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9903aacd-f6a3-4035-a105-81a76b69340f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:02:01.724790 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ffb5396-036c-41d4-b237-f1f47461a792 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:02:01.742857 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.auth.core [None req-9903aacd-f6a3-4035-a105-81a76b69340f None None] MFA Rules not processed for user `ae863915635746d1ac19970949de4722`. Rule list: `[]` (Enabled: `True`). {{(pid=81765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:02:01.744086 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-9903aacd-f6a3-4035-a105-81a76b69340f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:02:01.800912 dv-cinder-862365-1-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 366/719] 10.222.0.23 () {60 vars in 1144 bytes} [Fri Oct 28 19:02:01 2022] POST /identity/v3/endpoints => generated 346 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 19:02:01.832083 dv-cinder-862365-1-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 354/720] 10.222.0.23 () {58 vars in 1024 bytes} [Fri Oct 28 19:02:01 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 28 19:02:02.095969 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf268a22-a1a0-4f3b-ada2-1abbbfa089ec None None] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:02:02.096656 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf268a22-a1a0-4f3b-ada2-1abbbfa089ec None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:02:02.097159 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf268a22-a1a0-4f3b-ada2-1abbbfa089ec None None] PATH_INFO: `/` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:02:02.098982 dv-cinder-862365-1-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 367/721] 10.222.0.23 () {54 vars in 927 bytes} [Fri Oct 28 19:02:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 19:02:02.104841 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c886af1-dba3-417d-bd76-012d17c2243d None None] REQUEST_METHOD: `POST` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:02:02.105384 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c886af1-dba3-417d-bd76-012d17c2243d None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:02:02.105868 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c886af1-dba3-417d-bd76-012d17c2243d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:02:02.113014 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf268a22-a1a0-4f3b-ada2-1abbbfa089ec None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:02:02.126366 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.auth.core [None req-4c886af1-dba3-417d-bd76-012d17c2243d None None] MFA Rules not processed for user `ae863915635746d1ac19970949de4722`. Rule list: `[]` (Enabled: `True`). {{(pid=81765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:02:02.128471 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-4c886af1-dba3-417d-bd76-012d17c2243d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:02:02.157907 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:02:02.213405 dv-cinder-862365-1-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 355/722] 10.222.0.23 () {58 vars in 1024 bytes} [Fri Oct 28 19:02:02 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 28 19:02:02.214229 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ca03ec-cbe5-4b3c-a937-0ba7285d0df8 None None] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:02:02.214229 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ca03ec-cbe5-4b3c-a937-0ba7285d0df8 None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:02:02.214424 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ca03ec-cbe5-4b3c-a937-0ba7285d0df8 None None] PATH_INFO: `/` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:02:02.220908 dv-cinder-862365-1-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 356/723] 10.222.0.23 () {54 vars in 927 bytes} [Fri Oct 28 19:02:02 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 19:02:02.222846 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52779375-1cbd-49d5-aadf-7043335a1b8c None None] REQUEST_METHOD: `POST` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:02:02.223132 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52779375-1cbd-49d5-aadf-7043335a1b8c None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:02:02.223410 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52779375-1cbd-49d5-aadf-7043335a1b8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:02:02.243783 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.auth.core [None req-52779375-1cbd-49d5-aadf-7043335a1b8c None None] MFA Rules not processed for user `ae863915635746d1ac19970949de4722`. Rule list: `[]` (Enabled: `True`). {{(pid=81765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:02:02.245396 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-52779375-1cbd-49d5-aadf-7043335a1b8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:02:02.253705 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf268a22-a1a0-4f3b-ada2-1abbbfa089ec None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:02:02.255375 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:02:02.292881 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02a22a1-65f9-46e0-9214-ab98d072bea6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:02:02.293566 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02a22a1-65f9-46e0-9214-ab98d072bea6 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:02:02.293851 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02a22a1-65f9-46e0-9214-ab98d072bea6 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:02:02.294125 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02a22a1-65f9-46e0-9214-ab98d072bea6 None admin] PATH_INFO: `/v3/services/image` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:02:02.294712 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02a22a1-65f9-46e0-9214-ab98d072bea6 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:02:02.296708 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02a22a1-65f9-46e0-9214-ab98d072bea6 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:02:02.308104 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application [None req-a02a22a1-65f9-46e0-9214-ab98d072bea6 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Oct 28 19:02:02.308104 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 19:02:02.308104 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 28 19:02:02.308104 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 28 19:02:02.308104 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 28 19:02:02.308104 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 28 19:02:02.308104 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 28 19:02:02.308104 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 28 19:02:02.308104 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Oct 28 19:02:02.308104 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Oct 28 19:02:02.308104 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 28 19:02:02.308104 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Oct 28 19:02:02.308104 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 19:02:02.308104 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 19:02:02.308104 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 19:02:02.308104 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 19:02:02.308104 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 19:02:02.309139 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 19:02:02.309139 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 19:02:02.309139 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 19:02:02.309139 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 19:02:02.309139 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 19:02:02.309139 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 19:02:02.309139 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 28 19:02:02.309139 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 28 19:02:02.309139 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 28 19:02:02.309139 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 28 19:02:02.309139 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 19:02:02.309139 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 19:02:02.309139 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 19:02:02.309139 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 19:02:02.309139 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 19:02:02.309139 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 19:02:02.310024 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 19:02:02.310024 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application with Lock( Oct 28 19:02:02.310024 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 19:02:02.310024 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._enter() Oct 28 19:02:02.310024 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 19:02:02.310024 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 19:02:02.310024 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 19:02:02.310024 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.creator() Oct 28 19:02:02.310024 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 19:02:02.310024 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application created_value = creator( Oct 28 19:02:02.310024 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 28 19:02:02.310024 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 28 19:02:02.310024 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Oct 28 19:02:02.310024 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Oct 28 19:02:02.313488 dv-cinder-862365-1-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 368/724] 10.222.0.23 () {56 vars in 1105 bytes} [Fri Oct 28 19:02:02 2022] GET /identity/v3/services/image => generated 86 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 28 19:02:02.318088 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02a22a1-65f9-46e0-9214-ab98d072bea6 None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:02:02.346217 dv-cinder-862365-1-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 357/725] 10.222.0.23 () {58 vars in 1024 bytes} [Fri Oct 28 19:02:02 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 28 19:02:02.428474 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02a22a1-65f9-46e0-9214-ab98d072bea6 None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:02:02.463486 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514322f3-a39d-4ad3-ad9d-b97cbd2e14fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:02:02.464089 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514322f3-a39d-4ad3-ad9d-b97cbd2e14fe None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:02:02.464368 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514322f3-a39d-4ad3-ad9d-b97cbd2e14fe None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:02:02.464639 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514322f3-a39d-4ad3-ad9d-b97cbd2e14fe None admin] PATH_INFO: `/v3/services` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:02:02.465257 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514322f3-a39d-4ad3-ad9d-b97cbd2e14fe None admin] RBAC: Adding query filter params (name=image) {{(pid=81766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:02:02.465588 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514322f3-a39d-4ad3-ad9d-b97cbd2e14fe None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:02:02.467006 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514322f3-a39d-4ad3-ad9d-b97cbd2e14fe None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:02:02.472090 dv-cinder-862365-1-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 369/726] 10.222.0.23 () {56 vars in 1108 bytes} [Fri Oct 28 19:02:02 2022] GET /identity/v3/services?name=image => generated 122 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:02:02.477688 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52779375-1cbd-49d5-aadf-7043335a1b8c None None] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:02:02.490887 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514322f3-a39d-4ad3-ad9d-b97cbd2e14fe None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:02:02.527782 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:02:02.573249 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:02:02.591240 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52779375-1cbd-49d5-aadf-7043335a1b8c None None] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:02:02.617190 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514322f3-a39d-4ad3-ad9d-b97cbd2e14fe None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:02:02.630154 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b1eeba-0bb1-4f86-9608-95feff85955c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:02:02.631063 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b1eeba-0bb1-4f86-9608-95feff85955c None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:02:02.631567 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b1eeba-0bb1-4f86-9608-95feff85955c None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:02:02.632058 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b1eeba-0bb1-4f86-9608-95feff85955c None admin] PATH_INFO: `/v3/services` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:02:02.632888 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b1eeba-0bb1-4f86-9608-95feff85955c None admin] RBAC: Adding query filter params (type=image) {{(pid=81765) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:02:02.633410 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b1eeba-0bb1-4f86-9608-95feff85955c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:02:02.635010 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b1eeba-0bb1-4f86-9608-95feff85955c None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:02:02.645635 dv-cinder-862365-1-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 358/727] 10.222.0.23 () {56 vars in 1108 bytes} [Fri Oct 28 19:02:02 2022] GET /identity/v3/services?type=image => generated 122 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:02:02.646485 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b1eeba-0bb1-4f86-9608-95feff85955c None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:02:02.663717 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac90c3f-7ba9-409c-955b-f966675ae2b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:02:02.664621 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac90c3f-7ba9-409c-955b-f966675ae2b9 None admin] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:02:02.664908 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac90c3f-7ba9-409c-955b-f966675ae2b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:02:02.665197 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac90c3f-7ba9-409c-955b-f966675ae2b9 None admin] PATH_INFO: `/v3/services` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:02:02.666929 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac90c3f-7ba9-409c-955b-f966675ae2b9 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:02:02.668913 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac90c3f-7ba9-409c-955b-f966675ae2b9 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:02:02.750026 dv-cinder-862365-1-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 370/728] 10.222.0.23 () {60 vars in 1141 bytes} [Fri Oct 28 19:02:02 2022] POST /identity/v3/services => generated 242 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 28 19:02:02.779675 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b1eeba-0bb1-4f86-9608-95feff85955c None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:02:02.831045 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce25e7a7-608d-4e16-b758-e8af6fb80e99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:02:02.832118 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce25e7a7-608d-4e16-b758-e8af6fb80e99 None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:02:02.832609 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce25e7a7-608d-4e16-b758-e8af6fb80e99 None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:02:02.833110 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce25e7a7-608d-4e16-b758-e8af6fb80e99 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:02:02.833952 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce25e7a7-608d-4e16-b758-e8af6fb80e99 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:02:02.835561 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce25e7a7-608d-4e16-b758-e8af6fb80e99 None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:02:02.853009 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application [None req-ce25e7a7-608d-4e16-b758-e8af6fb80e99 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 28 19:02:02.853009 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 19:02:02.853009 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 28 19:02:02.853009 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 28 19:02:02.853009 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 28 19:02:02.853009 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 28 19:02:02.853009 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 28 19:02:02.853009 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 28 19:02:02.853009 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 28 19:02:02.853009 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application Oct 28 19:02:02.853009 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 28 19:02:02.853009 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application Oct 28 19:02:02.853009 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 19:02:02.853009 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 19:02:02.853009 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 19:02:02.853009 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 19:02:02.853009 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 19:02:02.854774 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 19:02:02.854774 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 19:02:02.854774 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 19:02:02.854774 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 19:02:02.854774 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 19:02:02.854774 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 19:02:02.854774 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 28 19:02:02.854774 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 28 19:02:02.854774 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 28 19:02:02.854774 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 28 19:02:02.854774 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 19:02:02.854774 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 19:02:02.854774 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 19:02:02.854774 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 19:02:02.854774 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 19:02:02.854774 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 19:02:02.855791 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 19:02:02.855791 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application with Lock( Oct 28 19:02:02.855791 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 19:02:02.855791 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._enter() Oct 28 19:02:02.855791 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 19:02:02.855791 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 19:02:02.855791 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 19:02:02.855791 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.creator() Oct 28 19:02:02.855791 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 19:02:02.855791 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application created_value = creator( Oct 28 19:02:02.855791 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 28 19:02:02.855791 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 28 19:02:02.855791 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 28 19:02:02.855791 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application Oct 28 19:02:02.855791 dv-cinder-862365-1-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 359/729] 10.222.0.23 () {56 vars in 1126 bytes} [Fri Oct 28 19:02:02 2022] GET /identity/v3/services/object-store => generated 93 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 19:02:02.863977 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac90c3f-7ba9-409c-955b-f966675ae2b9 None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:02:02.967398 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:02:02.977286 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac90c3f-7ba9-409c-955b-f966675ae2b9 None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:02:03.014170 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8914c5-98e9-4c62-86af-8cba2f7751b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:02:03.014907 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8914c5-98e9-4c62-86af-8cba2f7751b8 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:02:03.015212 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8914c5-98e9-4c62-86af-8cba2f7751b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:02:03.015475 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8914c5-98e9-4c62-86af-8cba2f7751b8 None admin] PATH_INFO: `/v3/services` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:02:03.016102 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8914c5-98e9-4c62-86af-8cba2f7751b8 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:02:03.016402 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8914c5-98e9-4c62-86af-8cba2f7751b8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:02:03.017803 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8914c5-98e9-4c62-86af-8cba2f7751b8 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:02:03.023208 dv-cinder-862365-1-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 371/730] 10.222.0.23 () {56 vars in 1122 bytes} [Fri Oct 28 19:02:02 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:02:03.029662 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce25e7a7-608d-4e16-b758-e8af6fb80e99 None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:02:03.043659 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:02:03.140557 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce25e7a7-608d-4e16-b758-e8af6fb80e99 None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:02:03.176888 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ceec72-d39d-4f8c-9a6f-63197a2e359b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:02:03.177855 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ceec72-d39d-4f8c-9a6f-63197a2e359b None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:02:03.178284 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ceec72-d39d-4f8c-9a6f-63197a2e359b None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:02:03.178701 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ceec72-d39d-4f8c-9a6f-63197a2e359b None admin] PATH_INFO: `/v3/services` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:02:03.179475 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ceec72-d39d-4f8c-9a6f-63197a2e359b None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81765) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:02:03.179928 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ceec72-d39d-4f8c-9a6f-63197a2e359b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:02:03.181554 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ceec72-d39d-4f8c-9a6f-63197a2e359b None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:02:03.191686 dv-cinder-862365-1-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 360/731] 10.222.0.23 () {56 vars in 1122 bytes} [Fri Oct 28 19:02:03 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:02:03.193198 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8914c5-98e9-4c62-86af-8cba2f7751b8 None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:02:03.297093 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8914c5-98e9-4c62-86af-8cba2f7751b8 None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:02:03.332691 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec139d22-6c9b-484c-8a81-1bf403d5b0b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:02:03.333626 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec139d22-6c9b-484c-8a81-1bf403d5b0b2 None admin] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:02:03.334055 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec139d22-6c9b-484c-8a81-1bf403d5b0b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:02:03.334470 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec139d22-6c9b-484c-8a81-1bf403d5b0b2 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:02:03.335280 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec139d22-6c9b-484c-8a81-1bf403d5b0b2 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:02:03.337048 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec139d22-6c9b-484c-8a81-1bf403d5b0b2 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:02:03.437618 dv-cinder-862365-1-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 372/732] 10.222.0.23 () {60 vars in 1144 bytes} [Fri Oct 28 19:02:03 2022] POST /identity/v3/endpoints => generated 349 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 19:02:04.040398 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd40b056-0e51-4d32-936d-77a7af0845f0 None None] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:02:04.041525 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd40b056-0e51-4d32-936d-77a7af0845f0 None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:02:04.041525 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd40b056-0e51-4d32-936d-77a7af0845f0 None None] PATH_INFO: `/` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:02:04.043100 dv-cinder-862365-1-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 361/733] 10.222.0.23 () {54 vars in 927 bytes} [Fri Oct 28 19:02:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 19:02:04.048348 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e964cfa9-6d7e-45ca-b37b-7bb59fb16347 None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:02:04.048780 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e964cfa9-6d7e-45ca-b37b-7bb59fb16347 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:02:04.048904 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e964cfa9-6d7e-45ca-b37b-7bb59fb16347 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:02:04.067565 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-e964cfa9-6d7e-45ca-b37b-7bb59fb16347 None None] MFA Rules not processed for user `ae863915635746d1ac19970949de4722`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:02:04.068752 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-e964cfa9-6d7e-45ca-b37b-7bb59fb16347 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:02:04.072186 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:02:04.143329 dv-cinder-862365-1-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 373/734] 10.222.0.23 () {58 vars in 1024 bytes} [Fri Oct 28 19:02:04 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 28 19:02:04.414946 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd40b056-0e51-4d32-936d-77a7af0845f0 None None] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:02:04.496295 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:02:04.524009 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd40b056-0e51-4d32-936d-77a7af0845f0 None None] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:02:04.561203 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a367dfa-80e9-46ab-b373-673a14a79bc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:02:04.562218 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a367dfa-80e9-46ab-b373-673a14a79bc9 None admin] REQUEST_METHOD: `POST` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:02:04.562705 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a367dfa-80e9-46ab-b373-673a14a79bc9 None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:02:04.563178 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a367dfa-80e9-46ab-b373-673a14a79bc9 None admin] PATH_INFO: `/v3/projects` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:02:04.564054 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a367dfa-80e9-46ab-b373-673a14a79bc9 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:02:04.565710 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a367dfa-80e9-46ab-b373-673a14a79bc9 None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:02:04.568561 dv-cinder-862365-1-smb devstack@keystone.service[81765]: WARNING keystone.server.flask.common [None req-6a367dfa-80e9-46ab-b373-673a14a79bc9 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Oct 28 19:02:04.619235 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.sql.core [None req-6a367dfa-80e9-46ab-b373-673a14a79bc9 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Oct 28 19:02:04.619235 dv-cinder-862365-1-smb devstack@keystone.service[81765]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Oct 28 19:02:04.619235 dv-cinder-862365-1-smb devstack@keystone.service[81765]: [parameters: {'id': 'eb3cc6d3dd8d4ec78620ae6e35a5c73a', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Oct 28 19:02:04.619235 dv-cinder-862365-1-smb devstack@keystone.service[81765]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81765) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Oct 28 19:02:04.627204 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application [None req-6a367dfa-80e9-46ab-b373-673a14a79bc9 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id eb3cc6d3dd8d4ec78620ae6e35a5c73a.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id eb3cc6d3dd8d4ec78620ae6e35a5c73a. Oct 28 19:02:04.627204 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 19:02:04.627204 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 28 19:02:04.627204 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 28 19:02:04.627204 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 28 19:02:04.627204 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 28 19:02:04.627204 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 28 19:02:04.627204 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application result = self._query(query) Oct 28 19:02:04.627204 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 28 19:02:04.627204 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application conn.query(q) Oct 28 19:02:04.627204 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 28 19:02:04.627204 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 28 19:02:04.627204 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 28 19:02:04.627999 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application result.read() Oct 28 19:02:04.627999 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 28 19:02:04.627999 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 28 19:02:04.627999 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 28 19:02:04.627999 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 28 19:02:04.627999 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 28 19:02:04.627999 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 28 19:02:04.627999 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 28 19:02:04.627999 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 28 19:02:04.627999 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Oct 28 19:02:04.627999 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application Oct 28 19:02:04.627999 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Oct 28 19:02:04.627999 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application Oct 28 19:02:04.627999 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 19:02:04.627999 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Oct 28 19:02:04.627999 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return method(*args, **kwargs) Oct 28 19:02:04.627999 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Oct 28 19:02:04.627999 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return project_ref.to_dict() Oct 28 19:02:04.629014 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 28 19:02:04.629014 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application next(self.gen) Oct 28 19:02:04.629014 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1068, in _transaction_scope Oct 28 19:02:04.629014 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application yield resource Oct 28 19:02:04.629014 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 28 19:02:04.629014 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application next(self.gen) Oct 28 19:02:04.629014 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 670, in _session Oct 28 19:02:04.629014 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application self.session.rollback() Oct 28 19:02:04.629014 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 28 19:02:04.629014 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application self.force_reraise() Oct 28 19:02:04.629014 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 28 19:02:04.629014 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application raise self.value Oct 28 19:02:04.629014 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 667, in _session Oct 28 19:02:04.629014 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Oct 28 19:02:04.629014 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 695, in _end_session_transaction Oct 28 19:02:04.629014 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application session.commit() Oct 28 19:02:04.629014 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Oct 28 19:02:04.629993 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Oct 28 19:02:04.629993 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Oct 28 19:02:04.629993 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application self._prepare_impl() Oct 28 19:02:04.629993 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Oct 28 19:02:04.629993 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application self.session.flush() Oct 28 19:02:04.629993 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 28 19:02:04.629993 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application self._flush(objects) Oct 28 19:02:04.629993 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 28 19:02:04.629993 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Oct 28 19:02:04.629993 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 28 19:02:04.629993 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application compat.raise_( Oct 28 19:02:04.629993 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 28 19:02:04.629993 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application raise exception Oct 28 19:02:04.629993 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 28 19:02:04.629993 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application flush_context.execute() Oct 28 19:02:04.629993 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 28 19:02:04.629993 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application rec.execute(self) Oct 28 19:02:04.630942 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 28 19:02:04.630942 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Oct 28 19:02:04.630942 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 28 19:02:04.630942 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application _emit_insert_statements( Oct 28 19:02:04.630942 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Oct 28 19:02:04.630942 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application c = connection._execute_20( Oct 28 19:02:04.630942 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 28 19:02:04.630942 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Oct 28 19:02:04.630942 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 28 19:02:04.630942 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Oct 28 19:02:04.630942 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 28 19:02:04.630942 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application ret = self._execute_context( Oct 28 19:02:04.630942 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 28 19:02:04.630942 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Oct 28 19:02:04.630942 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 28 19:02:04.631736 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 28 19:02:04.631736 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 28 19:02:04.631736 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application raise exception Oct 28 19:02:04.631736 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 28 19:02:04.631736 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 28 19:02:04.631736 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 28 19:02:04.631736 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 28 19:02:04.631736 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 28 19:02:04.631736 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application result = self._query(query) Oct 28 19:02:04.631736 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 28 19:02:04.631736 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application conn.query(q) Oct 28 19:02:04.631736 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 28 19:02:04.631736 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 28 19:02:04.631736 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 28 19:02:04.631736 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application result.read() Oct 28 19:02:04.631736 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 28 19:02:04.631736 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 28 19:02:04.632624 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 28 19:02:04.632624 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 28 19:02:04.632624 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 28 19:02:04.632624 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 28 19:02:04.632624 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 28 19:02:04.632624 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 28 19:02:04.632624 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Oct 28 19:02:04.632624 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Oct 28 19:02:04.632624 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application [parameters: {'id': 'eb3cc6d3dd8d4ec78620ae6e35a5c73a', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Oct 28 19:02:04.632624 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 28 19:02:04.632624 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application Oct 28 19:02:04.632624 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 28 19:02:04.632624 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application Oct 28 19:02:04.632624 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 19:02:04.632624 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Oct 28 19:02:04.636460 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Oct 28 19:02:04.636460 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Oct 28 19:02:04.636460 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Oct 28 19:02:04.636460 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Oct 28 19:02:04.636460 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application Oct 28 19:02:04.636460 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 28 19:02:04.636460 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application Oct 28 19:02:04.636460 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 19:02:04.636460 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 19:02:04.636460 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 19:02:04.636460 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 19:02:04.636460 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 19:02:04.636460 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 19:02:04.636460 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 19:02:04.636460 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 19:02:04.636460 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 19:02:04.636460 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 19:02:04.638721 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 19:02:04.638721 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Oct 28 19:02:04.638721 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Oct 28 19:02:04.638721 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 19:02:04.638721 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 19:02:04.638721 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Oct 28 19:02:04.638721 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application raise exception.Conflict( Oct 28 19:02:04.638721 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id eb3cc6d3dd8d4ec78620ae6e35a5c73a. Oct 28 19:02:04.638721 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application Oct 28 19:02:04.641783 dv-cinder-862365-1-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 362/735] 10.222.0.23 () {60 vars in 1140 bytes} [Fri Oct 28 19:02:04 2022] POST /identity/v3/projects => generated 262 bytes in 227 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Oct 28 19:02:04.647464 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e964cfa9-6d7e-45ca-b37b-7bb59fb16347 None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:02:04.752812 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e964cfa9-6d7e-45ca-b37b-7bb59fb16347 None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:02:04.789610 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d22de5-895e-4ab8-adf3-9c67e68b2aad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:02:04.790242 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d22de5-895e-4ab8-adf3-9c67e68b2aad None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:02:04.790522 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d22de5-895e-4ab8-adf3-9c67e68b2aad None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:02:04.790823 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d22de5-895e-4ab8-adf3-9c67e68b2aad None admin] PATH_INFO: `/v3/projects/service` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:02:04.793776 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:02:04.799242 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d22de5-895e-4ab8-adf3-9c67e68b2aad None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:02:04.800624 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d22de5-895e-4ab8-adf3-9c67e68b2aad None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:02:04.812226 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application [None req-07d22de5-895e-4ab8-adf3-9c67e68b2aad None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 28 19:02:04.812226 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 19:02:04.812226 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 19:02:04.812226 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 19:02:04.812226 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 19:02:04.812226 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 19:02:04.812226 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 19:02:04.812226 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 19:02:04.812226 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 19:02:04.812226 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 19:02:04.812226 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 19:02:04.812226 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 19:02:04.812226 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 28 19:02:04.812226 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 28 19:02:04.812226 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 28 19:02:04.813205 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 28 19:02:04.813205 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 19:02:04.813205 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 19:02:04.813205 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 19:02:04.813205 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 19:02:04.813205 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 19:02:04.813205 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 19:02:04.813205 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 19:02:04.813205 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application with Lock( Oct 28 19:02:04.813205 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 19:02:04.813205 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._enter() Oct 28 19:02:04.813205 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 19:02:04.813205 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 19:02:04.813205 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 19:02:04.813205 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.creator() Oct 28 19:02:04.813205 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 19:02:04.813205 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application created_value = creator( Oct 28 19:02:04.814723 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 28 19:02:04.814723 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 28 19:02:04.814723 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 28 19:02:04.814723 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 28 19:02:04.814723 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 28 19:02:04.814723 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 28 19:02:04.814723 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 28 19:02:04.814723 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Oct 28 19:02:04.817847 dv-cinder-862365-1-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 374/736] 10.222.0.23 () {56 vars in 1111 bytes} [Fri Oct 28 19:02:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 19:02:04.819950 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a367dfa-80e9-46ab-b373-673a14a79bc9 None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:02:04.944725 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a367dfa-80e9-46ab-b373-673a14a79bc9 None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:02:04.948266 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6fc471-9fb4-4807-89a2-7938944466b6 None None] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:02:04.948780 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6fc471-9fb4-4807-89a2-7938944466b6 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:02:04.949309 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6fc471-9fb4-4807-89a2-7938944466b6 None None] PATH_INFO: `/` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:02:04.951728 dv-cinder-862365-1-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 375/737] 10.222.0.23 () {54 vars in 927 bytes} [Fri Oct 28 19:02:04 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 19:02:04.957404 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae904fab-9e55-439f-9b07-80e6a62ea9be None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:02:04.957722 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae904fab-9e55-439f-9b07-80e6a62ea9be None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:02:04.957973 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae904fab-9e55-439f-9b07-80e6a62ea9be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:02:04.977558 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:02:04.978753 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-ae904fab-9e55-439f-9b07-80e6a62ea9be None None] MFA Rules not processed for user `ae863915635746d1ac19970949de4722`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:02:04.980008 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-ae904fab-9e55-439f-9b07-80e6a62ea9be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:02:04.985058 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b16f36a-4c54-4941-b9f7-bdc5f194bcf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:02:04.985714 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b16f36a-4c54-4941-b9f7-bdc5f194bcf0 None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:02:04.986055 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b16f36a-4c54-4941-b9f7-bdc5f194bcf0 None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:02:04.986337 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b16f36a-4c54-4941-b9f7-bdc5f194bcf0 None admin] PATH_INFO: `/v3/projects` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:02:04.987006 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b16f36a-4c54-4941-b9f7-bdc5f194bcf0 None admin] RBAC: Adding query filter params (name=service) {{(pid=81765) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:02:04.987376 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b16f36a-4c54-4941-b9f7-bdc5f194bcf0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:02:04.989504 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b16f36a-4c54-4941-b9f7-bdc5f194bcf0 None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:02:05.015636 dv-cinder-862365-1-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 363/738] 10.222.0.23 () {56 vars in 1112 bytes} [Fri Oct 28 19:02:04 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:02:05.017077 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf03b09c-a009-4a30-b766-76b02468944f None None] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:02:05.021821 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf03b09c-a009-4a30-b766-76b02468944f None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:02:05.021821 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf03b09c-a009-4a30-b766-76b02468944f None None] PATH_INFO: `/` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:02:05.021821 dv-cinder-862365-1-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 364/739] 10.222.0.23 () {54 vars in 927 bytes} [Fri Oct 28 19:02:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 19:02:05.024925 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375fd41e-3539-4f46-9591-492e8fceb4f6 None None] REQUEST_METHOD: `POST` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:02:05.025452 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375fd41e-3539-4f46-9591-492e8fceb4f6 None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:02:05.026011 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375fd41e-3539-4f46-9591-492e8fceb4f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:02:05.051400 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.auth.core [None req-375fd41e-3539-4f46-9591-492e8fceb4f6 None None] MFA Rules not processed for user `ae863915635746d1ac19970949de4722`. Rule list: `[]` (Enabled: `True`). {{(pid=81765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:02:05.054645 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-375fd41e-3539-4f46-9591-492e8fceb4f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:02:05.073017 dv-cinder-862365-1-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 376/740] 10.222.0.23 () {58 vars in 1024 bytes} [Fri Oct 28 19:02:04 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 28 19:02:05.139020 dv-cinder-862365-1-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 365/741] 10.222.0.23 () {58 vars in 1024 bytes} [Fri Oct 28 19:02:05 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 28 19:02:05.349980 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae904fab-9e55-439f-9b07-80e6a62ea9be None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:02:05.402970 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375fd41e-3539-4f46-9591-492e8fceb4f6 None None] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:02:05.456631 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae904fab-9e55-439f-9b07-80e6a62ea9be None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:02:05.485330 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:02:05.495954 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa85d97-472e-4c7b-b622-231a712ee1e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:02:05.506439 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa85d97-472e-4c7b-b622-231a712ee1e4 None admin] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:02:05.506439 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa85d97-472e-4c7b-b622-231a712ee1e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:02:05.506439 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa85d97-472e-4c7b-b622-231a712ee1e4 None admin] PATH_INFO: `/v3/services` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:02:05.506439 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa85d97-472e-4c7b-b622-231a712ee1e4 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:02:05.506439 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa85d97-472e-4c7b-b622-231a712ee1e4 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:02:05.510269 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375fd41e-3539-4f46-9591-492e8fceb4f6 None None] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:02:05.530917 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:02:05.545320 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb647cd-261b-4b01-beee-5590b7e53069 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:02:05.545978 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb647cd-261b-4b01-beee-5590b7e53069 None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:02:05.546254 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb647cd-261b-4b01-beee-5590b7e53069 None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:02:05.546521 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb647cd-261b-4b01-beee-5590b7e53069 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:02:05.547094 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb647cd-261b-4b01-beee-5590b7e53069 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:02:05.548474 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb647cd-261b-4b01-beee-5590b7e53069 None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:02:05.557988 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application [None req-beb647cd-261b-4b01-beee-5590b7e53069 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Oct 28 19:02:05.557988 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 19:02:05.557988 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 28 19:02:05.557988 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 28 19:02:05.557988 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 28 19:02:05.557988 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 28 19:02:05.557988 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 28 19:02:05.557988 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 28 19:02:05.557988 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Oct 28 19:02:05.557988 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application Oct 28 19:02:05.557988 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 28 19:02:05.557988 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application Oct 28 19:02:05.557988 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 19:02:05.557988 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 19:02:05.557988 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 19:02:05.557988 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 19:02:05.557988 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 19:02:05.559030 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 19:02:05.559030 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 19:02:05.559030 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 19:02:05.559030 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 19:02:05.559030 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 19:02:05.559030 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 19:02:05.559030 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 28 19:02:05.559030 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 28 19:02:05.559030 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 28 19:02:05.559030 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 28 19:02:05.559030 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 19:02:05.559030 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 19:02:05.559030 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 19:02:05.559030 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 19:02:05.559030 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 19:02:05.559030 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 19:02:05.559915 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 19:02:05.559915 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application with Lock( Oct 28 19:02:05.559915 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 19:02:05.559915 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._enter() Oct 28 19:02:05.559915 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 19:02:05.559915 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 19:02:05.559915 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 19:02:05.559915 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.creator() Oct 28 19:02:05.559915 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 19:02:05.559915 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application created_value = creator( Oct 28 19:02:05.559915 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 28 19:02:05.559915 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 28 19:02:05.559915 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Oct 28 19:02:05.559915 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application Oct 28 19:02:05.563989 dv-cinder-862365-1-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 366/742] 10.222.0.23 () {56 vars in 1111 bytes} [Fri Oct 28 19:02:05 2022] GET /identity/v3/services/compute => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 19:02:05.564793 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb647cd-261b-4b01-beee-5590b7e53069 None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:02:05.611166 dv-cinder-862365-1-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 377/743] 10.222.0.23 () {60 vars in 1141 bytes} [Fri Oct 28 19:02:05 2022] POST /identity/v3/services => generated 242 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 19:02:05.688626 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb647cd-261b-4b01-beee-5590b7e53069 None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:02:05.735867 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89718afe-a943-4cfe-aa10-5815cd670903 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:02:05.736739 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89718afe-a943-4cfe-aa10-5815cd670903 None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:02:05.737194 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89718afe-a943-4cfe-aa10-5815cd670903 None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:02:05.737644 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89718afe-a943-4cfe-aa10-5815cd670903 None admin] PATH_INFO: `/v3/services` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:02:05.738428 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89718afe-a943-4cfe-aa10-5815cd670903 None admin] RBAC: Adding query filter params (name=compute) {{(pid=81765) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:02:05.738878 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89718afe-a943-4cfe-aa10-5815cd670903 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:02:05.740418 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89718afe-a943-4cfe-aa10-5815cd670903 None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:02:05.747472 dv-cinder-862365-1-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 367/744] 10.222.0.23 () {56 vars in 1112 bytes} [Fri Oct 28 19:02:05 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:02:05.755808 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa85d97-472e-4c7b-b622-231a712ee1e4 None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:02:05.778487 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c95403-b9f1-404a-80aa-c13c9e48e730 None None] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:02:05.778806 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c95403-b9f1-404a-80aa-c13c9e48e730 None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:02:05.779051 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c95403-b9f1-404a-80aa-c13c9e48e730 None None] PATH_INFO: `/` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:02:05.781259 dv-cinder-862365-1-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 368/745] 10.222.0.23 () {54 vars in 927 bytes} [Fri Oct 28 19:02:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 28 19:02:05.787384 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cba517-a7b0-4ef8-a5a1-8e6114ddce11 None None] REQUEST_METHOD: `POST` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:02:05.787675 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cba517-a7b0-4ef8-a5a1-8e6114ddce11 None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:02:05.787951 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cba517-a7b0-4ef8-a5a1-8e6114ddce11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:02:05.810963 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.auth.core [None req-43cba517-a7b0-4ef8-a5a1-8e6114ddce11 None None] MFA Rules not processed for user `ae863915635746d1ac19970949de4722`. Rule list: `[]` (Enabled: `True`). {{(pid=81765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:02:05.812288 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-43cba517-a7b0-4ef8-a5a1-8e6114ddce11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:02:05.862415 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:02:05.888012 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa85d97-472e-4c7b-b622-231a712ee1e4 None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:02:05.898593 dv-cinder-862365-1-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 369/746] 10.222.0.23 () {58 vars in 1024 bytes} [Fri Oct 28 19:02:05 2022] POST /identity/v3/auth/tokens => generated 1666 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 28 19:02:05.930191 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5755e0b-260e-4c0f-ac07-fdc1a846b0f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:02:05.931160 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5755e0b-260e-4c0f-ac07-fdc1a846b0f6 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:02:05.931615 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5755e0b-260e-4c0f-ac07-fdc1a846b0f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:02:05.932058 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5755e0b-260e-4c0f-ac07-fdc1a846b0f6 None admin] PATH_INFO: `/v3/services` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:02:05.932856 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5755e0b-260e-4c0f-ac07-fdc1a846b0f6 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:02:05.933340 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5755e0b-260e-4c0f-ac07-fdc1a846b0f6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:02:05.934970 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5755e0b-260e-4c0f-ac07-fdc1a846b0f6 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:02:05.940488 dv-cinder-862365-1-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 378/747] 10.222.0.23 () {56 vars in 1112 bytes} [Fri Oct 28 19:02:05 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:02:05.946545 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43cba517-a7b0-4ef8-a5a1-8e6114ddce11 None None] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:02:06.058459 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43cba517-a7b0-4ef8-a5a1-8e6114ddce11 None None] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:02:06.094506 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e243600-7151-426f-9a7e-b6b4413c0726 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:02:06.095118 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e243600-7151-426f-9a7e-b6b4413c0726 None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:02:06.095400 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e243600-7151-426f-9a7e-b6b4413c0726 None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:02:06.095675 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e243600-7151-426f-9a7e-b6b4413c0726 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:02:06.096381 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e243600-7151-426f-9a7e-b6b4413c0726 None admin] RBAC: Adding query filter params (interface=public, service_id=9d4ebdb305d840048b12edaa078b1d1a, region_id=RegionOne) {{(pid=81765) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:02:06.096689 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e243600-7151-426f-9a7e-b6b4413c0726 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:02:06.098087 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e243600-7151-426f-9a7e-b6b4413c0726 None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:02:06.104174 dv-cinder-862365-1-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 370/748] 10.222.0.23 () {56 vars in 1251 bytes} [Fri Oct 28 19:02:05 2022] GET /identity/v3/endpoints?service_id=9d4ebdb305d840048b12edaa078b1d1a&interface=public®ion_id=RegionOne => generated 194 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:02:06.109827 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5755e0b-260e-4c0f-ac07-fdc1a846b0f6 None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:02:06.167240 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:02:06.207991 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e243600-7151-426f-9a7e-b6b4413c0726 None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:02:06.230905 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5755e0b-260e-4c0f-ac07-fdc1a846b0f6 None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:02:06.256438 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:02:06.266267 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3850f38f-13c1-40fc-9313-6cfb24e1fe3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:02:06.266936 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3850f38f-13c1-40fc-9313-6cfb24e1fe3b None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:02:06.267218 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3850f38f-13c1-40fc-9313-6cfb24e1fe3b None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:02:06.267488 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3850f38f-13c1-40fc-9313-6cfb24e1fe3b None admin] PATH_INFO: `/v3/services` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:02:06.268090 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3850f38f-13c1-40fc-9313-6cfb24e1fe3b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:02:06.269484 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3850f38f-13c1-40fc-9313-6cfb24e1fe3b None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:02:06.277078 dv-cinder-862365-1-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 379/749] 10.222.0.23 () {56 vars in 1087 bytes} [Fri Oct 28 19:02:06 2022] GET /identity/v3/services => generated 1957 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 19:02:06.326509 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e243600-7151-426f-9a7e-b6b4413c0726 None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:02:06.366631 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53919c4f-c20d-43dc-b2d0-622e0b585f7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:02:06.367284 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53919c4f-c20d-43dc-b2d0-622e0b585f7a None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:02:06.367566 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53919c4f-c20d-43dc-b2d0-622e0b585f7a None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:02:06.367838 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53919c4f-c20d-43dc-b2d0-622e0b585f7a None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:02:06.368424 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53919c4f-c20d-43dc-b2d0-622e0b585f7a None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:02:06.369905 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53919c4f-c20d-43dc-b2d0-622e0b585f7a None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:02:06.379978 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application [None req-53919c4f-c20d-43dc-b2d0-622e0b585f7a None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 28 19:02:06.379978 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 19:02:06.379978 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 28 19:02:06.379978 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 28 19:02:06.379978 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 28 19:02:06.379978 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 28 19:02:06.379978 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 28 19:02:06.379978 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 28 19:02:06.379978 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 28 19:02:06.379978 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application Oct 28 19:02:06.379978 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 28 19:02:06.379978 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application Oct 28 19:02:06.379978 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 19:02:06.379978 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 19:02:06.379978 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 19:02:06.379978 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 19:02:06.379978 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 19:02:06.381029 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 19:02:06.381029 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 19:02:06.381029 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 19:02:06.381029 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 19:02:06.381029 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 19:02:06.381029 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 19:02:06.381029 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 28 19:02:06.381029 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 28 19:02:06.381029 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 28 19:02:06.381029 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 28 19:02:06.381029 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 19:02:06.381029 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 19:02:06.381029 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 19:02:06.381029 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 19:02:06.381029 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 19:02:06.381029 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 19:02:06.381988 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 19:02:06.381988 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application with Lock( Oct 28 19:02:06.381988 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 19:02:06.381988 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._enter() Oct 28 19:02:06.381988 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 19:02:06.381988 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 19:02:06.381988 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 19:02:06.381988 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.creator() Oct 28 19:02:06.381988 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 19:02:06.381988 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application created_value = creator( Oct 28 19:02:06.381988 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 28 19:02:06.381988 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 28 19:02:06.381988 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 28 19:02:06.381988 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application Oct 28 19:02:06.381988 dv-cinder-862365-1-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 371/750] 10.222.0.23 () {56 vars in 1126 bytes} [Fri Oct 28 19:02:06 2022] GET /identity/v3/services/object-store => generated 93 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 19:02:06.388399 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3850f38f-13c1-40fc-9313-6cfb24e1fe3b None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:02:06.500841 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3850f38f-13c1-40fc-9313-6cfb24e1fe3b None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:02:06.514880 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:02:06.535819 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab345fb-c100-40da-96e8-10e1ab4e9ed8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:02:06.536433 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab345fb-c100-40da-96e8-10e1ab4e9ed8 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:02:06.536716 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab345fb-c100-40da-96e8-10e1ab4e9ed8 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:02:06.536989 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab345fb-c100-40da-96e8-10e1ab4e9ed8 None admin] PATH_INFO: `/v3/services` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:02:06.537677 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab345fb-c100-40da-96e8-10e1ab4e9ed8 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:02:06.538050 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab345fb-c100-40da-96e8-10e1ab4e9ed8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:02:06.539475 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab345fb-c100-40da-96e8-10e1ab4e9ed8 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:02:06.545156 dv-cinder-862365-1-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 380/751] 10.222.0.23 () {56 vars in 1122 bytes} [Fri Oct 28 19:02:06 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:02:06.551102 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53919c4f-c20d-43dc-b2d0-622e0b585f7a None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:02:06.656919 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53919c4f-c20d-43dc-b2d0-622e0b585f7a None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:02:06.658700 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:02:06.693309 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3f7aac-a413-4725-86bf-98b419eb94e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:02:06.693952 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3f7aac-a413-4725-86bf-98b419eb94e9 None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:02:06.694232 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3f7aac-a413-4725-86bf-98b419eb94e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:02:06.694506 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3f7aac-a413-4725-86bf-98b419eb94e9 None admin] PATH_INFO: `/v3/services` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:02:06.695139 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f3f7aac-a413-4725-86bf-98b419eb94e9 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81765) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:02:06.695471 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f3f7aac-a413-4725-86bf-98b419eb94e9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:02:06.696987 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f3f7aac-a413-4725-86bf-98b419eb94e9 None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:02:06.702347 dv-cinder-862365-1-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 372/752] 10.222.0.23 () {56 vars in 1122 bytes} [Fri Oct 28 19:02:06 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:02:06.708331 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab345fb-c100-40da-96e8-10e1ab4e9ed8 None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:02:06.815584 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab345fb-c100-40da-96e8-10e1ab4e9ed8 None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:02:06.852630 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24e00e7-a14e-44b2-ae74-b8e96fb2e7ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:02:06.853989 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24e00e7-a14e-44b2-ae74-b8e96fb2e7ba None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:02:06.854273 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24e00e7-a14e-44b2-ae74-b8e96fb2e7ba None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:02:06.854550 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24e00e7-a14e-44b2-ae74-b8e96fb2e7ba None admin] PATH_INFO: `/v3/endpoints` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:02:06.855262 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24e00e7-a14e-44b2-ae74-b8e96fb2e7ba None admin] RBAC: Adding query filter params (interface=admin, service_id=d8c15e0c03e3437da3943b3ba75544ba, region_id=RegionOne) {{(pid=81766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:02:06.855572 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24e00e7-a14e-44b2-ae74-b8e96fb2e7ba None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:02:06.856934 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24e00e7-a14e-44b2-ae74-b8e96fb2e7ba None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:02:06.862681 dv-cinder-862365-1-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 381/753] 10.222.0.23 () {56 vars in 1249 bytes} [Fri Oct 28 19:02:06 2022] GET /identity/v3/endpoints?service_id=d8c15e0c03e3437da3943b3ba75544ba&interface=admin®ion_id=RegionOne => generated 193 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:02:06.868370 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3f7aac-a413-4725-86bf-98b419eb94e9 None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:02:06.975464 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3f7aac-a413-4725-86bf-98b419eb94e9 None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:02:07.010558 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e480172b-83e4-48fe-a5a2-582719ef2f0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:02:07.011173 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e480172b-83e4-48fe-a5a2-582719ef2f0b None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:02:07.011453 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e480172b-83e4-48fe-a5a2-582719ef2f0b None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:02:07.011725 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e480172b-83e4-48fe-a5a2-582719ef2f0b None admin] PATH_INFO: `/v3/services` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:02:07.012330 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e480172b-83e4-48fe-a5a2-582719ef2f0b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:02:07.013783 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e480172b-83e4-48fe-a5a2-582719ef2f0b None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:02:07.020884 dv-cinder-862365-1-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 373/754] 10.222.0.23 () {56 vars in 1087 bytes} [Fri Oct 28 19:02:06 2022] GET /identity/v3/services => generated 1957 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 19:02:07.334614 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30a54d6-6143-407b-9b63-0210a6119d7f None None] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:02:07.335136 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30a54d6-6143-407b-9b63-0210a6119d7f None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:02:07.335214 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30a54d6-6143-407b-9b63-0210a6119d7f None None] PATH_INFO: `/` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:02:07.337052 dv-cinder-862365-1-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 382/755] 10.222.0.23 () {54 vars in 927 bytes} [Fri Oct 28 19:02:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 19:02:07.342365 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc1f9c6-75b2-40b4-8986-36fcc8e86f70 None None] REQUEST_METHOD: `POST` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:02:07.342858 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc1f9c6-75b2-40b4-8986-36fcc8e86f70 None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:02:07.343014 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc1f9c6-75b2-40b4-8986-36fcc8e86f70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:02:07.361327 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.auth.core [None req-9fc1f9c6-75b2-40b4-8986-36fcc8e86f70 None None] MFA Rules not processed for user `ae863915635746d1ac19970949de4722`. Rule list: `[]` (Enabled: `True`). {{(pid=81765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:02:07.362543 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-9fc1f9c6-75b2-40b4-8986-36fcc8e86f70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:02:07.388155 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:02:07.433795 dv-cinder-862365-1-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 374/756] 10.222.0.23 () {58 vars in 1024 bytes} [Fri Oct 28 19:02:07 2022] POST /identity/v3/auth/tokens => generated 1666 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 28 19:02:07.704083 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30a54d6-6143-407b-9b63-0210a6119d7f None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:02:07.750169 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:02:07.811398 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30a54d6-6143-407b-9b63-0210a6119d7f None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:02:07.853301 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1928fc-e589-4e24-ad0a-9619c7ad0e19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:02:07.853969 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1928fc-e589-4e24-ad0a-9619c7ad0e19 None admin] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:02:07.854371 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1928fc-e589-4e24-ad0a-9619c7ad0e19 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:02:07.854652 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1928fc-e589-4e24-ad0a-9619c7ad0e19 None admin] PATH_INFO: `/v3/users` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:02:07.855320 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a1928fc-e589-4e24-ad0a-9619c7ad0e19 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:02:07.856899 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a1928fc-e589-4e24-ad0a-9619c7ad0e19 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:02:07.859697 dv-cinder-862365-1-smb devstack@keystone.service[81766]: WARNING keystone.server.flask.common [None req-7a1928fc-e589-4e24-ad0a-9619c7ad0e19 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Oct 28 19:02:07.911096 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.sql.core [None req-7a1928fc-e589-4e24-ad0a-9619c7ad0e19 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Oct 28 19:02:07.911096 dv-cinder-862365-1-smb devstack@keystone.service[81766]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Oct 28 19:02:07.911096 dv-cinder-862365-1-smb devstack@keystone.service[81766]: [parameters: {'user_id': 'f9c9df928a4c4213a19deb241d0facdc', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Oct 28 19:02:07.911096 dv-cinder-862365-1-smb devstack@keystone.service[81766]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81766) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Oct 28 19:02:07.918927 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application [None req-7a1928fc-e589-4e24-ad0a-9619c7ad0e19 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Oct 28 19:02:07.918927 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 19:02:07.918927 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 28 19:02:07.918927 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 28 19:02:07.918927 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 28 19:02:07.918927 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 28 19:02:07.918927 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 28 19:02:07.918927 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application result = self._query(query) Oct 28 19:02:07.918927 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 28 19:02:07.918927 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application conn.query(q) Oct 28 19:02:07.918927 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 28 19:02:07.918927 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 28 19:02:07.918927 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 28 19:02:07.918927 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application result.read() Oct 28 19:02:07.918927 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 28 19:02:07.920982 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 28 19:02:07.920982 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 28 19:02:07.920982 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 28 19:02:07.920982 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 28 19:02:07.920982 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 28 19:02:07.920982 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 28 19:02:07.920982 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 28 19:02:07.920982 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Oct 28 19:02:07.920982 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Oct 28 19:02:07.920982 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Oct 28 19:02:07.920982 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Oct 28 19:02:07.920982 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 19:02:07.920982 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Oct 28 19:02:07.920982 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return method(*args, **kwargs) Oct 28 19:02:07.920982 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Oct 28 19:02:07.920982 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Oct 28 19:02:07.920982 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 28 19:02:07.920982 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application next(self.gen) Oct 28 19:02:07.923323 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1068, in _transaction_scope Oct 28 19:02:07.923323 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application yield resource Oct 28 19:02:07.923323 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 28 19:02:07.923323 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application next(self.gen) Oct 28 19:02:07.923323 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 670, in _session Oct 28 19:02:07.923323 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application self.session.rollback() Oct 28 19:02:07.923323 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 28 19:02:07.923323 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application self.force_reraise() Oct 28 19:02:07.923323 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 28 19:02:07.923323 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application raise self.value Oct 28 19:02:07.923323 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 667, in _session Oct 28 19:02:07.923323 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Oct 28 19:02:07.923323 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 695, in _end_session_transaction Oct 28 19:02:07.923323 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application session.commit() Oct 28 19:02:07.923323 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Oct 28 19:02:07.923323 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Oct 28 19:02:07.923323 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Oct 28 19:02:07.928923 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application self._prepare_impl() Oct 28 19:02:07.928923 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Oct 28 19:02:07.928923 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application self.session.flush() Oct 28 19:02:07.928923 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 28 19:02:07.928923 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application self._flush(objects) Oct 28 19:02:07.928923 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 28 19:02:07.928923 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Oct 28 19:02:07.928923 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 28 19:02:07.928923 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application compat.raise_( Oct 28 19:02:07.928923 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 28 19:02:07.928923 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application raise exception Oct 28 19:02:07.928923 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 28 19:02:07.928923 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application flush_context.execute() Oct 28 19:02:07.928923 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 28 19:02:07.928923 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application rec.execute(self) Oct 28 19:02:07.928923 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 28 19:02:07.928923 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Oct 28 19:02:07.930126 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 28 19:02:07.930126 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application _emit_insert_statements( Oct 28 19:02:07.930126 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Oct 28 19:02:07.930126 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application result = connection._execute_20( Oct 28 19:02:07.930126 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 28 19:02:07.930126 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Oct 28 19:02:07.930126 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 28 19:02:07.930126 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Oct 28 19:02:07.930126 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 28 19:02:07.930126 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application ret = self._execute_context( Oct 28 19:02:07.930126 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 28 19:02:07.930126 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Oct 28 19:02:07.930126 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 28 19:02:07.930126 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 28 19:02:07.930126 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 28 19:02:07.930126 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application raise exception Oct 28 19:02:07.931193 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 28 19:02:07.931193 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 28 19:02:07.931193 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 28 19:02:07.931193 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 28 19:02:07.931193 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 28 19:02:07.931193 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application result = self._query(query) Oct 28 19:02:07.931193 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 28 19:02:07.931193 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application conn.query(q) Oct 28 19:02:07.931193 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 28 19:02:07.931193 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 28 19:02:07.931193 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 28 19:02:07.931193 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application result.read() Oct 28 19:02:07.931193 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 28 19:02:07.931193 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 28 19:02:07.931193 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 28 19:02:07.931193 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 28 19:02:07.932355 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 28 19:02:07.932355 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 28 19:02:07.932355 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 28 19:02:07.932355 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 28 19:02:07.932355 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Oct 28 19:02:07.932355 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Oct 28 19:02:07.932355 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application [parameters: {'user_id': 'f9c9df928a4c4213a19deb241d0facdc', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Oct 28 19:02:07.932355 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 28 19:02:07.932355 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Oct 28 19:02:07.932355 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 28 19:02:07.932355 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Oct 28 19:02:07.932355 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 19:02:07.932355 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 19:02:07.932355 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 19:02:07.932355 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 19:02:07.933281 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 19:02:07.933281 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 19:02:07.933281 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 19:02:07.933281 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 19:02:07.933281 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 19:02:07.933281 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 19:02:07.933281 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 19:02:07.933281 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Oct 28 19:02:07.933281 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Oct 28 19:02:07.933281 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 19:02:07.933281 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 19:02:07.933281 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 28 19:02:07.933281 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 28 19:02:07.933281 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 28 19:02:07.933281 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 28 19:02:07.933281 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Oct 28 19:02:07.933281 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Oct 28 19:02:07.934407 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Oct 28 19:02:07.934407 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Oct 28 19:02:07.934407 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Oct 28 19:02:07.934407 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Oct 28 19:02:07.934407 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Oct 28 19:02:07.934407 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Oct 28 19:02:07.934407 dv-cinder-862365-1-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 383/757] 10.222.0.23 () {60 vars in 1131 bytes} [Fri Oct 28 19:02:07 2022] POST /identity/v3/users => generated 160 bytes in 217 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Oct 28 19:02:07.934885 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc1f9c6-75b2-40b4-8986-36fcc8e86f70 None None] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:02:07.988459 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6c955e-40f7-47b5-8fbc-eea001da3899 None None] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:02:07.988803 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6c955e-40f7-47b5-8fbc-eea001da3899 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:02:07.989242 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6c955e-40f7-47b5-8fbc-eea001da3899 None None] PATH_INFO: `/` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:02:07.998562 dv-cinder-862365-1-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 384/758] 10.222.0.23 () {54 vars in 927 bytes} [Fri Oct 28 19:02:07 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 28 19:02:08.000209 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140d704c-5123-4c09-81cf-9b08cb6f2c10 None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:02:08.000593 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140d704c-5123-4c09-81cf-9b08cb6f2c10 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:02:08.000966 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140d704c-5123-4c09-81cf-9b08cb6f2c10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:02:08.020973 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-140d704c-5123-4c09-81cf-9b08cb6f2c10 None None] MFA Rules not processed for user `ae863915635746d1ac19970949de4722`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:02:08.022780 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-140d704c-5123-4c09-81cf-9b08cb6f2c10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:02:08.051086 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc1f9c6-75b2-40b4-8986-36fcc8e86f70 None None] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:02:08.092790 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c18046-7717-4e88-a2ea-25cb2315c91b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:02:08.093609 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c18046-7717-4e88-a2ea-25cb2315c91b None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:02:08.093958 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c18046-7717-4e88-a2ea-25cb2315c91b None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:02:08.094308 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c18046-7717-4e88-a2ea-25cb2315c91b None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:02:08.100786 dv-cinder-862365-1-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 385/759] 10.222.0.23 () {58 vars in 1024 bytes} [Fri Oct 28 19:02:07 2022] POST /identity/v3/auth/tokens => generated 1666 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 28 19:02:08.103314 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c18046-7717-4e88-a2ea-25cb2315c91b None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:02:08.104770 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c18046-7717-4e88-a2ea-25cb2315c91b None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:02:08.116600 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application [None req-36c18046-7717-4e88-a2ea-25cb2315c91b None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Oct 28 19:02:08.116600 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 19:02:08.116600 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 19:02:08.116600 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 19:02:08.116600 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 19:02:08.116600 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 19:02:08.116600 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 19:02:08.116600 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 19:02:08.116600 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 19:02:08.116600 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 19:02:08.116600 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 19:02:08.116600 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 19:02:08.116600 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 28 19:02:08.116600 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 28 19:02:08.116600 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 28 19:02:08.116600 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 28 19:02:08.117590 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 19:02:08.117590 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 19:02:08.117590 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 28 19:02:08.117590 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 28 19:02:08.117590 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 28 19:02:08.117590 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 28 19:02:08.117590 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 19:02:08.117590 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 19:02:08.117590 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 19:02:08.117590 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 19:02:08.117590 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 19:02:08.117590 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application with Lock( Oct 28 19:02:08.117590 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 19:02:08.117590 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._enter() Oct 28 19:02:08.117590 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 19:02:08.117590 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 19:02:08.117590 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 19:02:08.117590 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.creator() Oct 28 19:02:08.118541 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 19:02:08.118541 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application created_value = creator( Oct 28 19:02:08.118541 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 28 19:02:08.118541 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 28 19:02:08.118541 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 28 19:02:08.118541 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 28 19:02:08.118541 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 28 19:02:08.118541 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 28 19:02:08.118541 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Oct 28 19:02:08.118541 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application Oct 28 19:02:08.118541 dv-cinder-862365-1-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 375/760] 10.222.0.23 () {56 vars in 1099 bytes} [Fri Oct 28 19:02:07 2022] GET /identity/v3/users/cinder => generated 84 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 19:02:08.126411 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140d704c-5123-4c09-81cf-9b08cb6f2c10 None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:02:08.162198 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:02:08.238772 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140d704c-5123-4c09-81cf-9b08cb6f2c10 None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:02:08.277760 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96458290-2052-41dd-a290-501a72cfa7c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:02:08.278375 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96458290-2052-41dd-a290-501a72cfa7c6 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:02:08.278655 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96458290-2052-41dd-a290-501a72cfa7c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:02:08.278929 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96458290-2052-41dd-a290-501a72cfa7c6 None admin] PATH_INFO: `/v3/users` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:02:08.279619 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96458290-2052-41dd-a290-501a72cfa7c6 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=81766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:02:08.279920 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96458290-2052-41dd-a290-501a72cfa7c6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:02:08.281476 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96458290-2052-41dd-a290-501a72cfa7c6 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:02:08.316752 dv-cinder-862365-1-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 386/761] 10.222.0.23 () {56 vars in 1101 bytes} [Fri Oct 28 19:02:08 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:02:08.399567 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c18046-7717-4e88-a2ea-25cb2315c91b None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:02:08.427429 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:02:08.520733 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c18046-7717-4e88-a2ea-25cb2315c91b None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:02:08.526431 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1b1cb9-517a-4085-9bfc-66e047aee3cf None None] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:02:08.527232 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1b1cb9-517a-4085-9bfc-66e047aee3cf None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:02:08.527513 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1b1cb9-517a-4085-9bfc-66e047aee3cf None None] PATH_INFO: `/` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:02:08.529004 dv-cinder-862365-1-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 387/762] 10.222.0.23 () {54 vars in 927 bytes} [Fri Oct 28 19:02:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 28 19:02:08.534364 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035af262-745d-4f46-a09e-f09be1cc233f None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:02:08.534765 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035af262-745d-4f46-a09e-f09be1cc233f None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:02:08.535044 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035af262-745d-4f46-a09e-f09be1cc233f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:02:08.558661 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-035af262-745d-4f46-a09e-f09be1cc233f None None] MFA Rules not processed for user `ae863915635746d1ac19970949de4722`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:02:08.560069 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-035af262-745d-4f46-a09e-f09be1cc233f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:02:08.560407 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5abcb6ab-87b7-4858-a4b2-558a06070914 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:02:08.561039 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abcb6ab-87b7-4858-a4b2-558a06070914 None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:02:08.561317 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abcb6ab-87b7-4858-a4b2-558a06070914 None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:02:08.561644 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abcb6ab-87b7-4858-a4b2-558a06070914 None admin] PATH_INFO: `/v3/services/image` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:02:08.562219 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5abcb6ab-87b7-4858-a4b2-558a06070914 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:02:08.565529 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5abcb6ab-87b7-4858-a4b2-558a06070914 None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:02:08.573332 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application [None req-5abcb6ab-87b7-4858-a4b2-558a06070914 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Oct 28 19:02:08.573332 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 19:02:08.573332 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 28 19:02:08.573332 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 28 19:02:08.573332 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 28 19:02:08.573332 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 28 19:02:08.573332 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 28 19:02:08.573332 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 28 19:02:08.573332 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Oct 28 19:02:08.573332 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application Oct 28 19:02:08.573332 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 28 19:02:08.573332 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application Oct 28 19:02:08.573332 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 19:02:08.573332 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 19:02:08.573332 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 19:02:08.573332 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 19:02:08.573332 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 19:02:08.574339 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 19:02:08.574339 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 19:02:08.574339 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 19:02:08.574339 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 19:02:08.574339 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 19:02:08.574339 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 19:02:08.574339 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 28 19:02:08.574339 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 28 19:02:08.574339 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 28 19:02:08.574339 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 28 19:02:08.574339 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 19:02:08.574339 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 19:02:08.574339 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 19:02:08.574339 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 19:02:08.574339 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 19:02:08.574339 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 19:02:08.575171 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 19:02:08.575171 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application with Lock( Oct 28 19:02:08.575171 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 19:02:08.575171 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._enter() Oct 28 19:02:08.575171 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 19:02:08.575171 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 19:02:08.575171 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 19:02:08.575171 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.creator() Oct 28 19:02:08.575171 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 19:02:08.575171 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application created_value = creator( Oct 28 19:02:08.575171 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 28 19:02:08.575171 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 28 19:02:08.575171 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Oct 28 19:02:08.575171 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application Oct 28 19:02:08.575171 dv-cinder-862365-1-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 376/763] 10.222.0.23 () {56 vars in 1105 bytes} [Fri Oct 28 19:02:08 2022] GET /identity/v3/services/image => generated 86 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 19:02:08.580351 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5abcb6ab-87b7-4858-a4b2-558a06070914 None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:02:08.652761 dv-cinder-862365-1-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 388/764] 10.222.0.23 () {58 vars in 1024 bytes} [Fri Oct 28 19:02:08 2022] POST /identity/v3/auth/tokens => generated 1666 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 28 19:02:08.683113 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:02:08.698579 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5abcb6ab-87b7-4858-a4b2-558a06070914 None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:02:08.731662 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03ff025-b3d6-4221-b9da-f5a9681c912d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:02:08.732273 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03ff025-b3d6-4221-b9da-f5a9681c912d None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:02:08.732555 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03ff025-b3d6-4221-b9da-f5a9681c912d None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:02:08.732830 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03ff025-b3d6-4221-b9da-f5a9681c912d None admin] PATH_INFO: `/v3/services` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:02:08.733497 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03ff025-b3d6-4221-b9da-f5a9681c912d None admin] RBAC: Adding query filter params (name=image) {{(pid=81765) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:02:08.733807 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03ff025-b3d6-4221-b9da-f5a9681c912d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:02:08.735168 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03ff025-b3d6-4221-b9da-f5a9681c912d None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:02:08.745867 dv-cinder-862365-1-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 377/765] 10.222.0.23 () {56 vars in 1108 bytes} [Fri Oct 28 19:02:08 2022] GET /identity/v3/services?name=image => generated 122 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 19:02:08.747654 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035af262-745d-4f46-a09e-f09be1cc233f None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:02:08.772115 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:02:08.856181 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035af262-745d-4f46-a09e-f09be1cc233f None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:02:08.890760 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d15263-bfeb-46fd-b672-f83ad812c8aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:02:08.891378 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d15263-bfeb-46fd-b672-f83ad812c8aa None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:02:08.891659 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d15263-bfeb-46fd-b672-f83ad812c8aa None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:02:08.891933 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d15263-bfeb-46fd-b672-f83ad812c8aa None admin] PATH_INFO: `/v3/services` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:02:08.892564 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d15263-bfeb-46fd-b672-f83ad812c8aa None admin] RBAC: Adding query filter params (type=image) {{(pid=81766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:02:08.892870 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d15263-bfeb-46fd-b672-f83ad812c8aa None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:02:08.894258 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d15263-bfeb-46fd-b672-f83ad812c8aa None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:02:08.903895 dv-cinder-862365-1-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 389/766] 10.222.0.23 () {56 vars in 1108 bytes} [Fri Oct 28 19:02:08 2022] GET /identity/v3/services?type=image => generated 350 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:02:08.905505 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03ff025-b3d6-4221-b9da-f5a9681c912d None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:02:08.921822 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d15263-bfeb-46fd-b672-f83ad812c8aa None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:02:09.019068 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:02:09.021300 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03ff025-b3d6-4221-b9da-f5a9681c912d None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:02:09.038483 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d15263-bfeb-46fd-b672-f83ad812c8aa None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:02:09.056601 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7363aed-d52f-4cdc-95d6-5f0a157bf039 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:02:09.057209 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7363aed-d52f-4cdc-95d6-5f0a157bf039 None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:02:09.057526 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7363aed-d52f-4cdc-95d6-5f0a157bf039 None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:02:09.057800 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7363aed-d52f-4cdc-95d6-5f0a157bf039 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:02:09.058493 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7363aed-d52f-4cdc-95d6-5f0a157bf039 None admin] RBAC: Adding query filter params (interface=public, service_id=3134e21d732d417897620758bee3d257, region_id=RegionOne) {{(pid=81765) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:02:09.058801 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7363aed-d52f-4cdc-95d6-5f0a157bf039 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:02:09.060267 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7363aed-d52f-4cdc-95d6-5f0a157bf039 None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:02:09.065299 dv-cinder-862365-1-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 378/767] 10.222.0.23 () {56 vars in 1251 bytes} [Fri Oct 28 19:02:08 2022] GET /identity/v3/endpoints?service_id=3134e21d732d417897620758bee3d257&interface=public®ion_id=RegionOne => generated 194 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:02:09.070872 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7363aed-d52f-4cdc-95d6-5f0a157bf039 None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:02:09.079612 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6811a765-1038-4c58-a76d-99a29dbe1972 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:02:09.080245 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6811a765-1038-4c58-a76d-99a29dbe1972 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:02:09.080524 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6811a765-1038-4c58-a76d-99a29dbe1972 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:02:09.080795 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6811a765-1038-4c58-a76d-99a29dbe1972 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:02:09.081391 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6811a765-1038-4c58-a76d-99a29dbe1972 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:02:09.082755 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6811a765-1038-4c58-a76d-99a29dbe1972 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:02:09.087809 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:02:09.091934 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application [None req-6811a765-1038-4c58-a76d-99a29dbe1972 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Oct 28 19:02:09.091934 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 19:02:09.091934 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 28 19:02:09.091934 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 28 19:02:09.091934 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 28 19:02:09.091934 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 28 19:02:09.091934 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 28 19:02:09.091934 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 28 19:02:09.091934 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Oct 28 19:02:09.091934 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Oct 28 19:02:09.091934 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 28 19:02:09.091934 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Oct 28 19:02:09.091934 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 19:02:09.091934 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 19:02:09.091934 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 19:02:09.091934 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 19:02:09.091934 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 19:02:09.093118 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 19:02:09.093118 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 19:02:09.093118 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 19:02:09.093118 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 19:02:09.093118 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 19:02:09.093118 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 19:02:09.093118 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 28 19:02:09.093118 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 28 19:02:09.093118 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 28 19:02:09.093118 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 28 19:02:09.093118 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 19:02:09.093118 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 19:02:09.093118 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 19:02:09.093118 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 19:02:09.093118 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 19:02:09.093118 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 19:02:09.094303 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 19:02:09.094303 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application with Lock( Oct 28 19:02:09.094303 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 19:02:09.094303 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._enter() Oct 28 19:02:09.094303 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 19:02:09.094303 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 19:02:09.094303 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 19:02:09.094303 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.creator() Oct 28 19:02:09.094303 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 19:02:09.094303 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application created_value = creator( Oct 28 19:02:09.094303 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 28 19:02:09.094303 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 28 19:02:09.094303 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Oct 28 19:02:09.094303 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Oct 28 19:02:09.097853 dv-cinder-862365-1-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 390/768] 10.222.0.23 () {56 vars in 1111 bytes} [Fri Oct 28 19:02:08 2022] GET /identity/v3/services/compute => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 28 19:02:09.098711 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6811a765-1038-4c58-a76d-99a29dbe1972 None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:02:09.182837 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7363aed-d52f-4cdc-95d6-5f0a157bf039 None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:02:09.198458 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6811a765-1038-4c58-a76d-99a29dbe1972 None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:02:09.219879 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0529918a-4843-4a01-8d11-b0176797c0ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:02:09.220501 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0529918a-4843-4a01-8d11-b0176797c0ae None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:02:09.220905 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0529918a-4843-4a01-8d11-b0176797c0ae None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:02:09.221188 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0529918a-4843-4a01-8d11-b0176797c0ae None admin] PATH_INFO: `/v3/services` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:02:09.221850 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0529918a-4843-4a01-8d11-b0176797c0ae None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:02:09.223273 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0529918a-4843-4a01-8d11-b0176797c0ae None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:02:09.239947 dv-cinder-862365-1-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 379/769] 10.222.0.23 () {56 vars in 1087 bytes} [Fri Oct 28 19:02:09 2022] GET /identity/v3/services => generated 1957 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 19:02:09.240168 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6d7b27-9a80-4ef0-af2e-7270f408734d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:02:09.240168 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6d7b27-9a80-4ef0-af2e-7270f408734d None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:02:09.240168 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6d7b27-9a80-4ef0-af2e-7270f408734d None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:02:09.240168 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6d7b27-9a80-4ef0-af2e-7270f408734d None admin] PATH_INFO: `/v3/services` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:02:09.240527 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6d7b27-9a80-4ef0-af2e-7270f408734d None admin] RBAC: Adding query filter params (name=compute) {{(pid=81766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:02:09.240527 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6d7b27-9a80-4ef0-af2e-7270f408734d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:02:09.240527 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6d7b27-9a80-4ef0-af2e-7270f408734d None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:02:09.246113 dv-cinder-862365-1-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 391/770] 10.222.0.23 () {56 vars in 1112 bytes} [Fri Oct 28 19:02:09 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 19:02:09.252157 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0529918a-4843-4a01-8d11-b0176797c0ae None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:02:09.336095 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:02:09.345480 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853a2f2c-8fc6-4689-860a-a26f214feff3 None None] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:02:09.356710 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853a2f2c-8fc6-4689-860a-a26f214feff3 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:02:09.356710 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853a2f2c-8fc6-4689-860a-a26f214feff3 None None] PATH_INFO: `/` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:02:09.356710 dv-cinder-862365-1-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 392/771] 10.222.0.23 () {54 vars in 927 bytes} [Fri Oct 28 19:02:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 19:02:09.356710 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290686e1-8b2f-42c5-b5ad-bea4170c5c92 None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:02:09.356710 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290686e1-8b2f-42c5-b5ad-bea4170c5c92 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:02:09.356710 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290686e1-8b2f-42c5-b5ad-bea4170c5c92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:02:09.362080 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0529918a-4843-4a01-8d11-b0176797c0ae None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:02:09.374101 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-290686e1-8b2f-42c5-b5ad-bea4170c5c92 None None] MFA Rules not processed for user `ae863915635746d1ac19970949de4722`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:02:09.375332 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-290686e1-8b2f-42c5-b5ad-bea4170c5c92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:02:09.385738 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:02:09.402343 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2aedf7-7cfd-40b5-92d3-74d45a8373ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:02:09.403080 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2aedf7-7cfd-40b5-92d3-74d45a8373ae None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:02:09.403419 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2aedf7-7cfd-40b5-92d3-74d45a8373ae None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:02:09.403695 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2aedf7-7cfd-40b5-92d3-74d45a8373ae None admin] PATH_INFO: `/v3/services` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:02:09.404930 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2aedf7-7cfd-40b5-92d3-74d45a8373ae None admin] RBAC: Adding query filter params (type=compute) {{(pid=81765) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:02:09.405248 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2aedf7-7cfd-40b5-92d3-74d45a8373ae None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:02:09.406877 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2aedf7-7cfd-40b5-92d3-74d45a8373ae None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:02:09.417506 dv-cinder-862365-1-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 380/772] 10.222.0.23 () {56 vars in 1112 bytes} [Fri Oct 28 19:02:09 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:02:09.420100 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2aedf7-7cfd-40b5-92d3-74d45a8373ae None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:02:09.451004 dv-cinder-862365-1-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 393/773] 10.222.0.23 () {58 vars in 1024 bytes} [Fri Oct 28 19:02:09 2022] POST /identity/v3/auth/tokens => generated 1666 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 28 19:02:09.527023 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2aedf7-7cfd-40b5-92d3-74d45a8373ae None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:02:09.561144 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7ea2cd-f796-4486-95b3-d421ac862560 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:02:09.561781 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7ea2cd-f796-4486-95b3-d421ac862560 None admin] REQUEST_METHOD: `POST` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:02:09.562059 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7ea2cd-f796-4486-95b3-d421ac862560 None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:02:09.562330 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7ea2cd-f796-4486-95b3-d421ac862560 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:02:09.562991 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc7ea2cd-f796-4486-95b3-d421ac862560 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:02:09.564374 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc7ea2cd-f796-4486-95b3-d421ac862560 None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:02:09.574057 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:02:09.643076 dv-cinder-862365-1-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 381/774] 10.222.0.23 () {60 vars in 1144 bytes} [Fri Oct 28 19:02:09 2022] POST /identity/v3/endpoints => generated 334 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 28 19:02:09.721467 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290686e1-8b2f-42c5-b5ad-bea4170c5c92 None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:02:09.833321 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290686e1-8b2f-42c5-b5ad-bea4170c5c92 None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:02:09.877855 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2634ce-4e0e-4adb-a802-69dad5ecdb35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:02:09.878495 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2634ce-4e0e-4adb-a802-69dad5ecdb35 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:02:09.878777 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2634ce-4e0e-4adb-a802-69dad5ecdb35 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:02:09.879052 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2634ce-4e0e-4adb-a802-69dad5ecdb35 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:02:09.879631 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2634ce-4e0e-4adb-a802-69dad5ecdb35 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:02:09.880979 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2634ce-4e0e-4adb-a802-69dad5ecdb35 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:02:09.891077 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application [None req-9b2634ce-4e0e-4adb-a802-69dad5ecdb35 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 28 19:02:09.891077 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 19:02:09.891077 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 28 19:02:09.891077 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 28 19:02:09.891077 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 28 19:02:09.891077 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 28 19:02:09.891077 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 28 19:02:09.891077 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 28 19:02:09.891077 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 28 19:02:09.891077 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Oct 28 19:02:09.891077 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 28 19:02:09.891077 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Oct 28 19:02:09.891077 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 19:02:09.891077 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 19:02:09.891077 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 19:02:09.891077 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 19:02:09.891077 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 19:02:09.892310 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 19:02:09.892310 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 19:02:09.892310 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 19:02:09.892310 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 19:02:09.892310 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 19:02:09.892310 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 19:02:09.892310 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 28 19:02:09.892310 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 28 19:02:09.892310 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 28 19:02:09.892310 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 28 19:02:09.892310 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 19:02:09.892310 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 19:02:09.892310 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 19:02:09.892310 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 19:02:09.892310 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 19:02:09.892310 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 19:02:09.893410 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 19:02:09.893410 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application with Lock( Oct 28 19:02:09.893410 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 19:02:09.893410 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._enter() Oct 28 19:02:09.893410 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 19:02:09.893410 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 19:02:09.893410 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 19:02:09.893410 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.creator() Oct 28 19:02:09.893410 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 19:02:09.893410 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application created_value = creator( Oct 28 19:02:09.893410 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 28 19:02:09.893410 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 28 19:02:09.893410 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 28 19:02:09.893410 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Oct 28 19:02:09.894759 dv-cinder-862365-1-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 394/775] 10.222.0.23 () {56 vars in 1126 bytes} [Fri Oct 28 19:02:09 2022] GET /identity/v3/services/object-store => generated 93 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 19:02:09.901237 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7ea2cd-f796-4486-95b3-d421ac862560 None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:02:10.010312 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7ea2cd-f796-4486-95b3-d421ac862560 None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:02:10.044549 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183036f2-b690-469e-b721-2a4be07b9ccc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:02:10.045167 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183036f2-b690-469e-b721-2a4be07b9ccc None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:02:10.045508 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183036f2-b690-469e-b721-2a4be07b9ccc None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:02:10.045791 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183036f2-b690-469e-b721-2a4be07b9ccc None admin] PATH_INFO: `/v3/services` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:02:10.046421 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183036f2-b690-469e-b721-2a4be07b9ccc None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81765) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:02:10.046726 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183036f2-b690-469e-b721-2a4be07b9ccc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:02:10.048097 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183036f2-b690-469e-b721-2a4be07b9ccc None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:02:10.057678 dv-cinder-862365-1-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 382/776] 10.222.0.23 () {56 vars in 1122 bytes} [Fri Oct 28 19:02:09 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:02:10.058879 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2634ce-4e0e-4adb-a802-69dad5ecdb35 None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:02:10.062648 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:02:10.163387 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2634ce-4e0e-4adb-a802-69dad5ecdb35 None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:02:10.196443 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ecbe898-8b1e-46a2-93d2-13e38971c3d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:02:10.197611 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecbe898-8b1e-46a2-93d2-13e38971c3d4 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:02:10.197898 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecbe898-8b1e-46a2-93d2-13e38971c3d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:02:10.198287 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecbe898-8b1e-46a2-93d2-13e38971c3d4 None admin] PATH_INFO: `/v3/services` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:02:10.198915 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ecbe898-8b1e-46a2-93d2-13e38971c3d4 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:02:10.199218 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ecbe898-8b1e-46a2-93d2-13e38971c3d4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:02:10.200580 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ecbe898-8b1e-46a2-93d2-13e38971c3d4 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:02:10.205692 dv-cinder-862365-1-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 395/777] 10.222.0.23 () {56 vars in 1122 bytes} [Fri Oct 28 19:02:10 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 19:02:10.211130 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183036f2-b690-469e-b721-2a4be07b9ccc None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:02:10.281905 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:02:10.323775 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183036f2-b690-469e-b721-2a4be07b9ccc None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:02:10.356396 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46ff27c-2f22-4030-bb38-c80c2b07c82f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:02:10.356999 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46ff27c-2f22-4030-bb38-c80c2b07c82f None admin] REQUEST_METHOD: `POST` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:02:10.357283 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46ff27c-2f22-4030-bb38-c80c2b07c82f None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:02:10.357587 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46ff27c-2f22-4030-bb38-c80c2b07c82f None admin] PATH_INFO: `/v3/endpoints` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:02:10.358263 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46ff27c-2f22-4030-bb38-c80c2b07c82f None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:02:10.359716 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46ff27c-2f22-4030-bb38-c80c2b07c82f None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:02:10.445480 dv-cinder-862365-1-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 383/778] 10.222.0.23 () {60 vars in 1144 bytes} [Fri Oct 28 19:02:10 2022] POST /identity/v3/endpoints => generated 325 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 28 19:02:11.409962 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230d0025-fd99-4127-8b71-2395d7676d24 None None] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:02:11.410510 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230d0025-fd99-4127-8b71-2395d7676d24 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:02:11.410510 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230d0025-fd99-4127-8b71-2395d7676d24 None None] PATH_INFO: `/` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:02:11.411849 dv-cinder-862365-1-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 396/779] 10.222.0.23 () {54 vars in 927 bytes} [Fri Oct 28 19:02:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 19:02:11.417343 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7763ebd-bcd0-4cf4-b9fb-d8918e8c6dea None None] REQUEST_METHOD: `POST` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:02:11.417667 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7763ebd-bcd0-4cf4-b9fb-d8918e8c6dea None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:02:11.417947 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7763ebd-bcd0-4cf4-b9fb-d8918e8c6dea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:02:11.435986 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.auth.core [None req-a7763ebd-bcd0-4cf4-b9fb-d8918e8c6dea None None] MFA Rules not processed for user `ae863915635746d1ac19970949de4722`. Rule list: `[]` (Enabled: `True`). {{(pid=81765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:02:11.437163 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-a7763ebd-bcd0-4cf4-b9fb-d8918e8c6dea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:02:11.511888 dv-cinder-862365-1-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 384/780] 10.222.0.23 () {58 vars in 1024 bytes} [Fri Oct 28 19:02:11 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 28 19:02:11.781108 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230d0025-fd99-4127-8b71-2395d7676d24 None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:02:11.861203 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:02:11.879229 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3522d5-23bb-476d-963d-440a4e823999 None None] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:02:11.879517 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3522d5-23bb-476d-963d-440a4e823999 None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:02:11.879794 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3522d5-23bb-476d-963d-440a4e823999 None None] PATH_INFO: `/` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:02:11.881177 dv-cinder-862365-1-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 385/781] 10.222.0.23 () {54 vars in 927 bytes} [Fri Oct 28 19:02:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 28 19:02:11.886250 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82b0a00-9554-4ab2-abff-18baab58bc1b None None] REQUEST_METHOD: `POST` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:02:11.886990 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82b0a00-9554-4ab2-abff-18baab58bc1b None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:02:11.886990 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82b0a00-9554-4ab2-abff-18baab58bc1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:02:11.905136 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.auth.core [None req-d82b0a00-9554-4ab2-abff-18baab58bc1b None None] MFA Rules not processed for user `ae863915635746d1ac19970949de4722`. Rule list: `[]` (Enabled: `True`). {{(pid=81765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:02:11.906354 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-d82b0a00-9554-4ab2-abff-18baab58bc1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:02:11.922357 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230d0025-fd99-4127-8b71-2395d7676d24 None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:02:11.949865 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:02:11.956257 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b591c4-6b91-4498-acf1-cc08d0522f91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:02:11.956958 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b591c4-6b91-4498-acf1-cc08d0522f91 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:02:11.957305 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b591c4-6b91-4498-acf1-cc08d0522f91 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:02:11.957637 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b591c4-6b91-4498-acf1-cc08d0522f91 None admin] PATH_INFO: `/v3/services/image` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:02:11.958214 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b591c4-6b91-4498-acf1-cc08d0522f91 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:02:11.959563 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b591c4-6b91-4498-acf1-cc08d0522f91 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:02:11.969193 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application [None req-52b591c4-6b91-4498-acf1-cc08d0522f91 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Oct 28 19:02:11.969193 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 19:02:11.969193 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 28 19:02:11.969193 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 28 19:02:11.969193 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 28 19:02:11.969193 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 28 19:02:11.969193 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 28 19:02:11.969193 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 28 19:02:11.969193 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Oct 28 19:02:11.969193 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Oct 28 19:02:11.969193 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 28 19:02:11.969193 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Oct 28 19:02:11.969193 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 19:02:11.969193 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 19:02:11.969193 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 19:02:11.969193 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 19:02:11.969193 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 19:02:11.970309 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 19:02:11.970309 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 19:02:11.970309 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 19:02:11.970309 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 19:02:11.970309 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 19:02:11.970309 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 19:02:11.970309 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 28 19:02:11.970309 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 28 19:02:11.970309 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 28 19:02:11.970309 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 28 19:02:11.970309 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 19:02:11.970309 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 19:02:11.970309 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 19:02:11.970309 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 19:02:11.970309 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 19:02:11.970309 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 19:02:11.971181 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 19:02:11.971181 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application with Lock( Oct 28 19:02:11.971181 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 19:02:11.971181 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._enter() Oct 28 19:02:11.971181 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 19:02:11.971181 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 19:02:11.971181 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 19:02:11.971181 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.creator() Oct 28 19:02:11.971181 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 19:02:11.971181 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application created_value = creator( Oct 28 19:02:11.971181 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 28 19:02:11.971181 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 28 19:02:11.971181 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Oct 28 19:02:11.971181 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Oct 28 19:02:11.971181 dv-cinder-862365-1-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 397/782] 10.222.0.23 () {56 vars in 1105 bytes} [Fri Oct 28 19:02:11 2022] GET /identity/v3/services/image => generated 86 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 19:02:11.976410 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b591c4-6b91-4498-acf1-cc08d0522f91 None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:02:11.981428 dv-cinder-862365-1-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 386/783] 10.222.0.23 () {58 vars in 1024 bytes} [Fri Oct 28 19:02:11 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 28 19:02:12.078592 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b591c4-6b91-4498-acf1-cc08d0522f91 None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:02:12.109851 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:02:12.115709 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00a0104-7df0-47af-a9d4-fec5d0fa682f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:02:12.116322 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00a0104-7df0-47af-a9d4-fec5d0fa682f None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:02:12.116599 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00a0104-7df0-47af-a9d4-fec5d0fa682f None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:02:12.116868 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00a0104-7df0-47af-a9d4-fec5d0fa682f None admin] PATH_INFO: `/v3/services` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:02:12.117514 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00a0104-7df0-47af-a9d4-fec5d0fa682f None admin] RBAC: Adding query filter params (name=image) {{(pid=81766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:02:12.117876 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00a0104-7df0-47af-a9d4-fec5d0fa682f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:02:12.119235 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00a0104-7df0-47af-a9d4-fec5d0fa682f None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:02:12.124255 dv-cinder-862365-1-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 398/784] 10.222.0.23 () {56 vars in 1108 bytes} [Fri Oct 28 19:02:11 2022] GET /identity/v3/services?name=image => generated 122 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 19:02:12.130014 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82b0a00-9554-4ab2-abff-18baab58bc1b None None] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:02:12.232686 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82b0a00-9554-4ab2-abff-18baab58bc1b None None] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:02:12.249949 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00a0104-7df0-47af-a9d4-fec5d0fa682f None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:02:12.269652 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466fd215-e78a-4ac8-80f7-2d48f61069c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:02:12.270263 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466fd215-e78a-4ac8-80f7-2d48f61069c7 None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:02:12.270543 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466fd215-e78a-4ac8-80f7-2d48f61069c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:02:12.270816 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466fd215-e78a-4ac8-80f7-2d48f61069c7 None admin] PATH_INFO: `/v3/services` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:02:12.271441 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466fd215-e78a-4ac8-80f7-2d48f61069c7 None admin] RBAC: Adding query filter params (type=image) {{(pid=81765) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:02:12.271742 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466fd215-e78a-4ac8-80f7-2d48f61069c7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:02:12.273102 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466fd215-e78a-4ac8-80f7-2d48f61069c7 None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:02:12.279018 dv-cinder-862365-1-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 387/785] 10.222.0.23 () {56 vars in 1108 bytes} [Fri Oct 28 19:02:12 2022] GET /identity/v3/services?type=image => generated 350 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:02:12.284657 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466fd215-e78a-4ac8-80f7-2d48f61069c7 None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:02:12.332984 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:02:12.372267 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00a0104-7df0-47af-a9d4-fec5d0fa682f None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:02:12.395440 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466fd215-e78a-4ac8-80f7-2d48f61069c7 None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:02:12.407852 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0417659f-7534-446e-b0ee-972544c5e5e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:02:12.408491 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0417659f-7534-446e-b0ee-972544c5e5e4 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:02:12.408773 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0417659f-7534-446e-b0ee-972544c5e5e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:02:12.409039 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0417659f-7534-446e-b0ee-972544c5e5e4 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:02:12.421092 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0417659f-7534-446e-b0ee-972544c5e5e4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 19:02:12.425976 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application [None req-0417659f-7534-446e-b0ee-972544c5e5e4 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 28 19:02:12.425976 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 19:02:12.425976 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 19:02:12.425976 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 19:02:12.425976 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 19:02:12.425976 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 19:02:12.425976 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 19:02:12.425976 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 19:02:12.425976 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 19:02:12.425976 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 19:02:12.425976 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 19:02:12.425976 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 19:02:12.425976 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 28 19:02:12.425976 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 28 19:02:12.425976 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 28 19:02:12.425976 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 28 19:02:12.426904 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 28 19:02:12.426904 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 28 19:02:12.426904 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 28 19:02:12.426904 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 28 19:02:12.426904 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 19:02:12.426904 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 19:02:12.426904 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 19:02:12.426904 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 19:02:12.426904 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 19:02:12.426904 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 19:02:12.426904 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 19:02:12.426904 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application with Lock( Oct 28 19:02:12.426904 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 19:02:12.426904 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._enter() Oct 28 19:02:12.426904 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 19:02:12.426904 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 19:02:12.427990 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 19:02:12.427990 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.creator() Oct 28 19:02:12.427990 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 19:02:12.427990 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application created_value = creator( Oct 28 19:02:12.427990 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 28 19:02:12.427990 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 28 19:02:12.427990 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 28 19:02:12.427990 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 28 19:02:12.427990 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 28 19:02:12.427990 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 28 19:02:12.427990 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 28 19:02:12.427990 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Oct 28 19:02:12.427990 dv-cinder-862365-1-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 399/786] 10.222.0.23 () {56 vars in 1120 bytes} [Fri Oct 28 19:02:12 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 28 19:02:12.432877 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0417659f-7534-446e-b0ee-972544c5e5e4 None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:02:12.435561 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b759494f-3e0a-4570-bcb2-8e8f1c10e9c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:02:12.436184 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b759494f-3e0a-4570-bcb2-8e8f1c10e9c9 None admin] REQUEST_METHOD: `POST` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:02:12.436458 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b759494f-3e0a-4570-bcb2-8e8f1c10e9c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:02:12.436730 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b759494f-3e0a-4570-bcb2-8e8f1c10e9c9 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:02:12.437432 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b759494f-3e0a-4570-bcb2-8e8f1c10e9c9 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:02:12.438834 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b759494f-3e0a-4570-bcb2-8e8f1c10e9c9 None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:02:12.495562 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:02:12.515695 dv-cinder-862365-1-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 388/787] 10.222.0.23 () {60 vars in 1144 bytes} [Fri Oct 28 19:02:12 2022] POST /identity/v3/endpoints => generated 327 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 28 19:02:12.543801 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0417659f-7534-446e-b0ee-972544c5e5e4 None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:02:12.590390 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227f95f1-47b8-4eb7-b3b9-00194925c055 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:02:12.590926 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227f95f1-47b8-4eb7-b3b9-00194925c055 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:02:12.591202 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227f95f1-47b8-4eb7-b3b9-00194925c055 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:02:12.591476 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227f95f1-47b8-4eb7-b3b9-00194925c055 None admin] PATH_INFO: `/v3/roles` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:02:12.592208 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227f95f1-47b8-4eb7-b3b9-00194925c055 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:02:12.592506 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227f95f1-47b8-4eb7-b3b9-00194925c055 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:02:12.593128 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35834a97-47ff-445b-94af-e7f0554fcae6 None None] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:02:12.593468 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35834a97-47ff-445b-94af-e7f0554fcae6 None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:02:12.593850 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35834a97-47ff-445b-94af-e7f0554fcae6 None None] PATH_INFO: `/` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:02:12.594007 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227f95f1-47b8-4eb7-b3b9-00194925c055 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:02:12.595382 dv-cinder-862365-1-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 389/788] 10.222.0.23 () {54 vars in 927 bytes} [Fri Oct 28 19:02:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 19:02:12.601399 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af94e15-a940-442a-8f8f-d47f4c824d39 None None] REQUEST_METHOD: `POST` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:02:12.601617 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af94e15-a940-442a-8f8f-d47f4c824d39 None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:02:12.601941 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af94e15-a940-442a-8f8f-d47f4c824d39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:02:12.603945 dv-cinder-862365-1-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 400/789] 10.222.0.23 () {56 vars in 1115 bytes} [Fri Oct 28 19:02:12 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:02:12.609727 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227f95f1-47b8-4eb7-b3b9-00194925c055 None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:02:12.621959 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.auth.core [None req-5af94e15-a940-442a-8f8f-d47f4c824d39 None None] MFA Rules not processed for user `ae863915635746d1ac19970949de4722`. Rule list: `[]` (Enabled: `True`). {{(pid=81765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:02:12.623602 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-5af94e15-a940-442a-8f8f-d47f4c824d39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:02:12.701383 dv-cinder-862365-1-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 390/790] 10.222.0.23 () {58 vars in 1024 bytes} [Fri Oct 28 19:02:12 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 28 19:02:12.721724 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227f95f1-47b8-4eb7-b3b9-00194925c055 None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:02:12.735940 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:02:12.756590 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5167a6-a44e-4d6d-8d06-517dabcdbf23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:02:12.757218 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5167a6-a44e-4d6d-8d06-517dabcdbf23 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:02:12.757526 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5167a6-a44e-4d6d-8d06-517dabcdbf23 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:02:12.757795 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5167a6-a44e-4d6d-8d06-517dabcdbf23 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:02:12.768867 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5167a6-a44e-4d6d-8d06-517dabcdbf23 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:02:12.770337 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5167a6-a44e-4d6d-8d06-517dabcdbf23 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:02:12.785059 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application [None req-df5167a6-a44e-4d6d-8d06-517dabcdbf23 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 19:02:12.785059 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 19:02:12.785059 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 19:02:12.785059 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 19:02:12.785059 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 19:02:12.785059 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 19:02:12.785059 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 19:02:12.785059 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 19:02:12.785059 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 19:02:12.785059 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 19:02:12.785059 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 19:02:12.785059 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 19:02:12.785059 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 28 19:02:12.785059 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 28 19:02:12.785059 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 28 19:02:12.785059 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 28 19:02:12.786395 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 19:02:12.786395 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 19:02:12.786395 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 19:02:12.786395 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 19:02:12.786395 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 19:02:12.786395 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 19:02:12.786395 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 19:02:12.786395 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application with Lock( Oct 28 19:02:12.786395 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 19:02:12.786395 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._enter() Oct 28 19:02:12.786395 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 19:02:12.786395 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 19:02:12.786395 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 19:02:12.786395 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.creator() Oct 28 19:02:12.786395 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 19:02:12.786395 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application created_value = creator( Oct 28 19:02:12.786395 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 28 19:02:12.787498 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 28 19:02:12.787498 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 19:02:12.787498 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Oct 28 19:02:12.790209 dv-cinder-862365-1-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 401/791] 10.222.0.23 () {56 vars in 1108 bytes} [Fri Oct 28 19:02:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 28 19:02:12.795307 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af94e15-a940-442a-8f8f-d47f4c824d39 None None] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:02:12.824749 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:02:12.959056 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af94e15-a940-442a-8f8f-d47f4c824d39 None None] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:02:12.970698 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5167a6-a44e-4d6d-8d06-517dabcdbf23 None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:02:12.995496 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb4ffbd-fc53-4966-b5ff-56b55346cc1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:02:12.996107 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb4ffbd-fc53-4966-b5ff-56b55346cc1c None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:02:12.996431 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb4ffbd-fc53-4966-b5ff-56b55346cc1c None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:02:12.996877 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb4ffbd-fc53-4966-b5ff-56b55346cc1c None admin] PATH_INFO: `/v3/domains` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:02:12.997365 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb4ffbd-fc53-4966-b5ff-56b55346cc1c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81765) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:02:12.997679 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb4ffbd-fc53-4966-b5ff-56b55346cc1c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:02:12.999498 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb4ffbd-fc53-4966-b5ff-56b55346cc1c None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:02:13.012137 dv-cinder-862365-1-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 391/792] 10.222.0.23 () {56 vars in 1109 bytes} [Fri Oct 28 19:02:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:02:13.017495 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb4ffbd-fc53-4966-b5ff-56b55346cc1c None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:02:13.090885 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5167a6-a44e-4d6d-8d06-517dabcdbf23 None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:02:13.108863 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:02:13.124342 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb4ffbd-fc53-4966-b5ff-56b55346cc1c None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:02:13.126450 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7619176-db53-4589-a944-a9780125acd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:02:13.127355 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7619176-db53-4589-a944-a9780125acd2 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:02:13.127635 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7619176-db53-4589-a944-a9780125acd2 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:02:13.127904 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7619176-db53-4589-a944-a9780125acd2 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:02:13.128997 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7619176-db53-4589-a944-a9780125acd2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:02:13.130471 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7619176-db53-4589-a944-a9780125acd2 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:02:13.132250 dv-cinder-862365-1-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 402/793] 10.222.0.23 () {56 vars in 1108 bytes} [Fri Oct 28 19:02:12 2022] GET /identity/v3/domains/default => generated 199 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 19:02:13.138351 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7619176-db53-4589-a944-a9780125acd2 None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:02:13.160090 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2790fd6a-e293-4beb-a621-0a93e8d02fc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:02:13.160709 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2790fd6a-e293-4beb-a621-0a93e8d02fc2 None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:02:13.160989 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2790fd6a-e293-4beb-a621-0a93e8d02fc2 None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:02:13.161259 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2790fd6a-e293-4beb-a621-0a93e8d02fc2 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:02:13.168774 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2790fd6a-e293-4beb-a621-0a93e8d02fc2 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:02:13.170232 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2790fd6a-e293-4beb-a621-0a93e8d02fc2 None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:02:13.178911 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:02:13.181294 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application [None req-2790fd6a-e293-4beb-a621-0a93e8d02fc2 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 28 19:02:13.181294 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 19:02:13.181294 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 19:02:13.181294 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 19:02:13.181294 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 19:02:13.181294 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 19:02:13.181294 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 19:02:13.181294 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 19:02:13.181294 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 19:02:13.181294 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 19:02:13.181294 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 19:02:13.181294 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 19:02:13.181294 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 28 19:02:13.181294 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 28 19:02:13.181294 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 28 19:02:13.181294 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 28 19:02:13.182410 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 19:02:13.182410 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 19:02:13.182410 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 28 19:02:13.182410 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 28 19:02:13.182410 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 28 19:02:13.182410 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 28 19:02:13.182410 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 19:02:13.182410 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 19:02:13.182410 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 19:02:13.182410 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 19:02:13.182410 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 19:02:13.182410 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application with Lock( Oct 28 19:02:13.182410 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 19:02:13.182410 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._enter() Oct 28 19:02:13.182410 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 19:02:13.182410 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 19:02:13.182410 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 19:02:13.182410 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.creator() Oct 28 19:02:13.183541 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 19:02:13.183541 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application created_value = creator( Oct 28 19:02:13.183541 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 28 19:02:13.183541 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 28 19:02:13.183541 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 28 19:02:13.183541 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 28 19:02:13.183541 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 28 19:02:13.183541 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 28 19:02:13.183541 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 28 19:02:13.183541 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application Oct 28 19:02:13.187076 dv-cinder-862365-1-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 392/794] 10.222.0.23 () {56 vars in 1093 bytes} [Fri Oct 28 19:02:13 2022] GET /identity/v3/users/nova => generated 82 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 28 19:02:13.187903 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2790fd6a-e293-4beb-a621-0a93e8d02fc2 None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:02:13.255115 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7619176-db53-4589-a944-a9780125acd2 None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:02:13.291178 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03162de-6dc5-42eb-b81e-656cb32a1590 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:02:13.291786 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03162de-6dc5-42eb-b81e-656cb32a1590 None admin] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:02:13.292061 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03162de-6dc5-42eb-b81e-656cb32a1590 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:02:13.292336 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03162de-6dc5-42eb-b81e-656cb32a1590 None admin] PATH_INFO: `/v3/projects` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:02:13.292971 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03162de-6dc5-42eb-b81e-656cb32a1590 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:02:13.294443 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03162de-6dc5-42eb-b81e-656cb32a1590 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:02:13.295687 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2790fd6a-e293-4beb-a621-0a93e8d02fc2 None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:02:13.332441 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e612704d-5fbc-47aa-9c33-685fd326ed78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:02:13.333077 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e612704d-5fbc-47aa-9c33-685fd326ed78 None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:02:13.333372 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e612704d-5fbc-47aa-9c33-685fd326ed78 None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:02:13.333648 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e612704d-5fbc-47aa-9c33-685fd326ed78 None admin] PATH_INFO: `/v3/users` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:02:13.334369 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e612704d-5fbc-47aa-9c33-685fd326ed78 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81765) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:02:13.334669 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e612704d-5fbc-47aa-9c33-685fd326ed78 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:02:13.336070 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e612704d-5fbc-47aa-9c33-685fd326ed78 None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:02:13.353259 dv-cinder-862365-1-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 393/795] 10.222.0.23 () {56 vars in 1133 bytes} [Fri Oct 28 19:02:13 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 19:02:13.358964 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e612704d-5fbc-47aa-9c33-685fd326ed78 None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:02:13.362352 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:02:13.381134 dv-cinder-862365-1-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 403/796] 10.222.0.23 () {60 vars in 1141 bytes} [Fri Oct 28 19:02:13 2022] POST /identity/v3/projects => generated 311 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 28 19:02:13.471886 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e612704d-5fbc-47aa-9c33-685fd326ed78 None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:02:13.508314 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812576e6-f3d0-4cd1-8baa-3f21ebc861ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:02:13.508960 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812576e6-f3d0-4cd1-8baa-3f21ebc861ac None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:02:13.509826 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812576e6-f3d0-4cd1-8baa-3f21ebc861ac None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:02:13.510103 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812576e6-f3d0-4cd1-8baa-3f21ebc861ac None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:02:13.521240 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812576e6-f3d0-4cd1-8baa-3f21ebc861ac None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:02:13.522787 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812576e6-f3d0-4cd1-8baa-3f21ebc861ac None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:02:13.539057 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application [None req-812576e6-f3d0-4cd1-8baa-3f21ebc861ac None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 19:02:13.539057 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 19:02:13.539057 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 19:02:13.539057 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 19:02:13.539057 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 19:02:13.539057 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 19:02:13.539057 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 19:02:13.539057 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 19:02:13.539057 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 19:02:13.539057 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 19:02:13.539057 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 19:02:13.539057 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 19:02:13.539057 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 28 19:02:13.539057 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 28 19:02:13.539057 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 28 19:02:13.539057 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 28 19:02:13.540104 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 19:02:13.540104 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 19:02:13.540104 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 19:02:13.540104 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 19:02:13.540104 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 19:02:13.540104 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 19:02:13.540104 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 19:02:13.540104 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application with Lock( Oct 28 19:02:13.540104 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 19:02:13.540104 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._enter() Oct 28 19:02:13.540104 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 19:02:13.540104 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 19:02:13.540104 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 19:02:13.540104 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.creator() Oct 28 19:02:13.540104 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 19:02:13.540104 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application created_value = creator( Oct 28 19:02:13.540104 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 28 19:02:13.541688 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 28 19:02:13.541688 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 19:02:13.541688 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application Oct 28 19:02:13.541688 dv-cinder-862365-1-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 394/797] 10.222.0.23 () {56 vars in 1108 bytes} [Fri Oct 28 19:02:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 28 19:02:13.546634 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03162de-6dc5-42eb-b81e-656cb32a1590 None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:02:13.637448 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:02:13.653085 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03162de-6dc5-42eb-b81e-656cb32a1590 None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:02:13.688404 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9e035f-5ec7-45d2-9678-6d7308d0e11f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:02:13.689015 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9e035f-5ec7-45d2-9678-6d7308d0e11f None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:02:13.689291 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9e035f-5ec7-45d2-9678-6d7308d0e11f None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:02:13.689584 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9e035f-5ec7-45d2-9678-6d7308d0e11f None admin] PATH_INFO: `/v3/domains` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:02:13.693848 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b9e035f-5ec7-45d2-9678-6d7308d0e11f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:02:13.693848 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b9e035f-5ec7-45d2-9678-6d7308d0e11f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:02:13.693848 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b9e035f-5ec7-45d2-9678-6d7308d0e11f None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:02:13.703366 dv-cinder-862365-1-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 404/798] 10.222.0.23 () {56 vars in 1109 bytes} [Fri Oct 28 19:02:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:02:13.709124 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812576e6-f3d0-4cd1-8baa-3f21ebc861ac None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:02:13.765519 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:02:13.810853 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812576e6-f3d0-4cd1-8baa-3f21ebc861ac None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:02:13.850525 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad11a78-5634-4203-a32d-1d77b375e5ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:02:13.851162 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad11a78-5634-4203-a32d-1d77b375e5ec None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:02:13.851442 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad11a78-5634-4203-a32d-1d77b375e5ec None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:02:13.851716 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad11a78-5634-4203-a32d-1d77b375e5ec None admin] PATH_INFO: `/v3/projects/service` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:02:13.859340 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad11a78-5634-4203-a32d-1d77b375e5ec None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:02:13.860787 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad11a78-5634-4203-a32d-1d77b375e5ec None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:02:13.873013 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application [None req-9ad11a78-5634-4203-a32d-1d77b375e5ec None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 28 19:02:13.873013 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 19:02:13.873013 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 19:02:13.873013 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 19:02:13.873013 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 19:02:13.873013 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 19:02:13.873013 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 19:02:13.873013 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 19:02:13.873013 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 19:02:13.873013 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 19:02:13.873013 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 19:02:13.873013 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 19:02:13.873013 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 28 19:02:13.873013 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 28 19:02:13.873013 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 28 19:02:13.874094 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 28 19:02:13.874094 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 19:02:13.874094 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 19:02:13.874094 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 19:02:13.874094 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 19:02:13.874094 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 19:02:13.874094 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 19:02:13.874094 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 19:02:13.874094 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application with Lock( Oct 28 19:02:13.874094 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 19:02:13.874094 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._enter() Oct 28 19:02:13.874094 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 19:02:13.874094 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 19:02:13.874094 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 19:02:13.874094 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.creator() Oct 28 19:02:13.874094 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 19:02:13.874094 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application created_value = creator( Oct 28 19:02:13.874985 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 28 19:02:13.874985 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 28 19:02:13.874985 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 28 19:02:13.874985 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 28 19:02:13.874985 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 28 19:02:13.874985 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 28 19:02:13.874985 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 28 19:02:13.874985 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application Oct 28 19:02:13.876207 dv-cinder-862365-1-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 395/799] 10.222.0.23 () {56 vars in 1111 bytes} [Fri Oct 28 19:02:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 19:02:13.880189 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9e035f-5ec7-45d2-9678-6d7308d0e11f None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:02:13.985821 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9e035f-5ec7-45d2-9678-6d7308d0e11f None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:02:14.020707 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5efb318-8a0c-4f35-a3c6-7c314235d510 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:02:14.021321 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5efb318-8a0c-4f35-a3c6-7c314235d510 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:02:14.021629 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5efb318-8a0c-4f35-a3c6-7c314235d510 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:02:14.021905 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5efb318-8a0c-4f35-a3c6-7c314235d510 None admin] PATH_INFO: `/v3/projects` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:02:14.022581 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5efb318-8a0c-4f35-a3c6-7c314235d510 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:02:14.022887 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5efb318-8a0c-4f35-a3c6-7c314235d510 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:02:14.024410 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5efb318-8a0c-4f35-a3c6-7c314235d510 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:02:14.037488 dv-cinder-862365-1-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 405/800] 10.222.0.23 () {56 vars in 1148 bytes} [Fri Oct 28 19:02:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 19:02:14.043409 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad11a78-5634-4203-a32d-1d77b375e5ec None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:02:14.145336 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad11a78-5634-4203-a32d-1d77b375e5ec None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:02:14.162043 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:02:14.180248 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9659bc45-6a78-4149-bdc2-3150e0974947 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:02:14.180909 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9659bc45-6a78-4149-bdc2-3150e0974947 None admin] REQUEST_METHOD: `PUT` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:02:14.181220 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9659bc45-6a78-4149-bdc2-3150e0974947 None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:02:14.181530 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9659bc45-6a78-4149-bdc2-3150e0974947 None admin] PATH_INFO: `/v3/projects/b705897907f042c0818a931052438e1e/users/8877180cd9844dad8b0980de34769ec8/roles/2250592f6f214a5d8bf3c0a36c04f738` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:02:14.183652 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9659bc45-6a78-4149-bdc2-3150e0974947 None admin] RBAC: Authorizing `identity:create_grant(project_id=b705897907f042c0818a931052438e1e, user_id=8877180cd9844dad8b0980de34769ec8, role_id=2250592f6f214a5d8bf3c0a36c04f738)` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:02:14.185113 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9659bc45-6a78-4149-bdc2-3150e0974947 None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:02:14.246083 dv-cinder-862365-1-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 396/801] 10.222.0.23 () {58 vars in 1439 bytes} [Fri Oct 28 19:02:14 2022] PUT /identity/v3/projects/b705897907f042c0818a931052438e1e/users/8877180cd9844dad8b0980de34769ec8/roles/2250592f6f214a5d8bf3c0a36c04f738 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 19:02:14.753724 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8dd7c4-7964-4fae-a637-2455fcd1df46 None None] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:02:14.754249 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8dd7c4-7964-4fae-a637-2455fcd1df46 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:02:14.754331 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8dd7c4-7964-4fae-a637-2455fcd1df46 None None] PATH_INFO: `/` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:02:14.755754 dv-cinder-862365-1-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 406/802] 10.222.0.23 () {54 vars in 927 bytes} [Fri Oct 28 19:02:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 19:02:14.761407 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af0c80f-f558-4cf7-8335-7d7ba65784e6 None None] REQUEST_METHOD: `POST` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:02:14.761825 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af0c80f-f558-4cf7-8335-7d7ba65784e6 None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:02:14.761994 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af0c80f-f558-4cf7-8335-7d7ba65784e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:02:14.780473 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.auth.core [None req-6af0c80f-f558-4cf7-8335-7d7ba65784e6 None None] MFA Rules not processed for user `ae863915635746d1ac19970949de4722`. Rule list: `[]` (Enabled: `True`). {{(pid=81765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:02:14.781695 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-6af0c80f-f558-4cf7-8335-7d7ba65784e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:02:14.856066 dv-cinder-862365-1-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 397/803] 10.222.0.23 () {58 vars in 1024 bytes} [Fri Oct 28 19:02:14 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 28 19:02:15.125936 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8dd7c4-7964-4fae-a637-2455fcd1df46 None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:02:15.134863 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:02:15.229160 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8dd7c4-7964-4fae-a637-2455fcd1df46 None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:02:15.263751 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b4c902-679c-4480-ad55-44882a4c5583 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:02:15.264357 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b4c902-679c-4480-ad55-44882a4c5583 None admin] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:02:15.264641 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b4c902-679c-4480-ad55-44882a4c5583 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:02:15.264918 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b4c902-679c-4480-ad55-44882a4c5583 None admin] PATH_INFO: `/v3/domains` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:02:15.265607 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b4c902-679c-4480-ad55-44882a4c5583 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:02:15.267118 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b4c902-679c-4480-ad55-44882a4c5583 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:02:15.296915 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.sql.core [None req-11b4c902-679c-4480-ad55-44882a4c5583 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry '<>-Default' for key 'project.ixu_project_name_domain_id'") Oct 28 19:02:15.296915 dv-cinder-862365-1-smb devstack@keystone.service[81766]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Oct 28 19:02:15.296915 dv-cinder-862365-1-smb devstack@keystone.service[81766]: [parameters: {'id': 'bf69c8dc035242e08e7d9c7a000ec751', 'name': 'Default', 'domain_id': '<>', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': None, 'is_domain': 1}] Oct 28 19:02:15.296915 dv-cinder-862365-1-smb devstack@keystone.service[81766]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81766) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Oct 28 19:02:15.304225 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application [None req-11b4c902-679c-4480-ad55-44882a4c5583 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: Default.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: Default. Oct 28 19:02:15.304225 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 19:02:15.304225 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 28 19:02:15.304225 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 28 19:02:15.304225 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 28 19:02:15.304225 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 28 19:02:15.304225 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 28 19:02:15.304225 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application result = self._query(query) Oct 28 19:02:15.304225 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 28 19:02:15.304225 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application conn.query(q) Oct 28 19:02:15.304225 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 28 19:02:15.304225 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 28 19:02:15.304225 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 28 19:02:15.304225 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application result.read() Oct 28 19:02:15.305060 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 28 19:02:15.305060 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 28 19:02:15.305060 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 28 19:02:15.305060 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 28 19:02:15.305060 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 28 19:02:15.305060 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 28 19:02:15.305060 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 28 19:02:15.305060 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 28 19:02:15.305060 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry '<>-Default' for key 'project.ixu_project_name_domain_id'") Oct 28 19:02:15.305060 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Oct 28 19:02:15.305060 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Oct 28 19:02:15.305060 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Oct 28 19:02:15.305060 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 19:02:15.305060 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Oct 28 19:02:15.305060 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return method(*args, **kwargs) Oct 28 19:02:15.305060 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Oct 28 19:02:15.305060 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return project_ref.to_dict() Oct 28 19:02:15.305060 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 28 19:02:15.306642 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application next(self.gen) Oct 28 19:02:15.306642 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1068, in _transaction_scope Oct 28 19:02:15.306642 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application yield resource Oct 28 19:02:15.306642 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 28 19:02:15.306642 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application next(self.gen) Oct 28 19:02:15.306642 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 670, in _session Oct 28 19:02:15.306642 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application self.session.rollback() Oct 28 19:02:15.306642 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 28 19:02:15.306642 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application self.force_reraise() Oct 28 19:02:15.306642 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 28 19:02:15.306642 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application raise self.value Oct 28 19:02:15.306642 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 667, in _session Oct 28 19:02:15.306642 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Oct 28 19:02:15.306642 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 695, in _end_session_transaction Oct 28 19:02:15.306642 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application session.commit() Oct 28 19:02:15.306642 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Oct 28 19:02:15.306642 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Oct 28 19:02:15.307533 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Oct 28 19:02:15.307533 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application self._prepare_impl() Oct 28 19:02:15.307533 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Oct 28 19:02:15.307533 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application self.session.flush() Oct 28 19:02:15.307533 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 28 19:02:15.307533 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application self._flush(objects) Oct 28 19:02:15.307533 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 28 19:02:15.307533 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Oct 28 19:02:15.307533 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 28 19:02:15.307533 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application compat.raise_( Oct 28 19:02:15.307533 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 28 19:02:15.307533 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application raise exception Oct 28 19:02:15.307533 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 28 19:02:15.307533 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application flush_context.execute() Oct 28 19:02:15.307533 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 28 19:02:15.307533 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application rec.execute(self) Oct 28 19:02:15.307533 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 28 19:02:15.308473 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Oct 28 19:02:15.308473 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 28 19:02:15.308473 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application _emit_insert_statements( Oct 28 19:02:15.308473 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Oct 28 19:02:15.308473 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application c = connection._execute_20( Oct 28 19:02:15.308473 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 28 19:02:15.308473 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Oct 28 19:02:15.308473 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 28 19:02:15.308473 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Oct 28 19:02:15.308473 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 28 19:02:15.308473 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application ret = self._execute_context( Oct 28 19:02:15.308473 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 28 19:02:15.308473 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Oct 28 19:02:15.308473 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 28 19:02:15.308473 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 28 19:02:15.309278 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 28 19:02:15.309278 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application raise exception Oct 28 19:02:15.309278 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 28 19:02:15.309278 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 28 19:02:15.309278 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 28 19:02:15.309278 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 28 19:02:15.309278 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 28 19:02:15.309278 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application result = self._query(query) Oct 28 19:02:15.309278 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 28 19:02:15.309278 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application conn.query(q) Oct 28 19:02:15.309278 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 28 19:02:15.309278 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 28 19:02:15.309278 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 28 19:02:15.309278 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application result.read() Oct 28 19:02:15.309278 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 28 19:02:15.309278 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 28 19:02:15.309278 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 28 19:02:15.314809 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 28 19:02:15.314809 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 28 19:02:15.314809 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 28 19:02:15.314809 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 28 19:02:15.314809 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 28 19:02:15.314809 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry '<>-Default' for key 'project.ixu_project_name_domain_id'") Oct 28 19:02:15.314809 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Oct 28 19:02:15.314809 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application [parameters: {'id': 'bf69c8dc035242e08e7d9c7a000ec751', 'name': 'Default', 'domain_id': '<>', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': None, 'is_domain': 1}] Oct 28 19:02:15.314809 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 28 19:02:15.314809 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Oct 28 19:02:15.314809 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 28 19:02:15.314809 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Oct 28 19:02:15.314809 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 19:02:15.314809 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Oct 28 19:02:15.314809 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Oct 28 19:02:15.315759 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Oct 28 19:02:15.315759 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Oct 28 19:02:15.315759 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name Default. Oct 28 19:02:15.315759 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Oct 28 19:02:15.315759 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 28 19:02:15.315759 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Oct 28 19:02:15.315759 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 19:02:15.315759 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 19:02:15.315759 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 19:02:15.315759 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 19:02:15.315759 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 19:02:15.315759 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 19:02:15.315759 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 19:02:15.315759 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 19:02:15.315759 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 19:02:15.315759 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 19:02:15.315759 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 19:02:15.316829 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 128, in post Oct 28 19:02:15.316829 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_domain( Oct 28 19:02:15.316829 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 19:02:15.316829 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 19:02:15.316829 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 765, in create_domain Oct 28 19:02:15.316829 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application is_domain_project = self.create_project( Oct 28 19:02:15.316829 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 19:02:15.316829 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 19:02:15.316829 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Oct 28 19:02:15.316829 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application raise exception.Conflict( Oct 28 19:02:15.316829 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: Default. Oct 28 19:02:15.316829 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Oct 28 19:02:15.316829 dv-cinder-862365-1-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 407/804] 10.222.0.23 () {60 vars in 1137 bytes} [Fri Oct 28 19:02:15 2022] POST /identity/v3/domains => generated 190 bytes in 185 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Oct 28 19:02:15.317702 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af0c80f-f558-4cf7-8335-7d7ba65784e6 None None] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:02:15.416439 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af0c80f-f558-4cf7-8335-7d7ba65784e6 None None] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:02:15.423837 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:02:15.451061 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a815a489-d07e-40a9-9384-10b719a50bf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:02:15.451688 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a815a489-d07e-40a9-9384-10b719a50bf1 None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:02:15.451969 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a815a489-d07e-40a9-9384-10b719a50bf1 None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:02:15.452243 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a815a489-d07e-40a9-9384-10b719a50bf1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:02:15.463026 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a815a489-d07e-40a9-9384-10b719a50bf1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:02:15.464483 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a815a489-d07e-40a9-9384-10b719a50bf1 None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:02:15.481520 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application [None req-a815a489-d07e-40a9-9384-10b719a50bf1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 19:02:15.481520 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 19:02:15.481520 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 19:02:15.481520 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 19:02:15.481520 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 19:02:15.481520 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 19:02:15.481520 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 19:02:15.481520 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 19:02:15.481520 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 19:02:15.481520 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 19:02:15.481520 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 19:02:15.481520 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 19:02:15.481520 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 28 19:02:15.481520 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 28 19:02:15.481520 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 28 19:02:15.481520 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 28 19:02:15.482557 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 19:02:15.482557 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 19:02:15.482557 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 19:02:15.482557 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 19:02:15.482557 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 19:02:15.482557 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 19:02:15.482557 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 19:02:15.482557 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application with Lock( Oct 28 19:02:15.482557 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 19:02:15.482557 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._enter() Oct 28 19:02:15.482557 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 19:02:15.482557 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 19:02:15.482557 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 19:02:15.482557 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.creator() Oct 28 19:02:15.482557 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 19:02:15.482557 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application created_value = creator( Oct 28 19:02:15.482557 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 28 19:02:15.489111 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 28 19:02:15.489111 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 19:02:15.489111 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application Oct 28 19:02:15.489111 dv-cinder-862365-1-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 398/805] 10.222.0.23 () {56 vars in 1108 bytes} [Fri Oct 28 19:02:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 19:02:15.489725 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b4c902-679c-4480-ad55-44882a4c5583 None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:02:15.561928 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:02:15.592552 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b4c902-679c-4480-ad55-44882a4c5583 None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:02:15.595467 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903122b4-8958-4101-a176-e44124b73a12 None None] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:02:15.595756 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903122b4-8958-4101-a176-e44124b73a12 None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:02:15.596031 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903122b4-8958-4101-a176-e44124b73a12 None None] PATH_INFO: `/` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:02:15.597677 dv-cinder-862365-1-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 399/806] 10.222.0.23 () {54 vars in 927 bytes} [Fri Oct 28 19:02:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 28 19:02:15.602480 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa50ebe2-9050-4471-8d27-7e709d9cc923 None None] REQUEST_METHOD: `POST` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:02:15.602764 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa50ebe2-9050-4471-8d27-7e709d9cc923 None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:02:15.603624 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa50ebe2-9050-4471-8d27-7e709d9cc923 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:02:15.622525 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.auth.core [None req-fa50ebe2-9050-4471-8d27-7e709d9cc923 None None] MFA Rules not processed for user `ae863915635746d1ac19970949de4722`. Rule list: `[]` (Enabled: `True`). {{(pid=81765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:02:15.623909 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-fa50ebe2-9050-4471-8d27-7e709d9cc923 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:02:15.631919 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfdd8af-f3b5-4fc4-8000-9b5dc4847cfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:02:15.632527 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfdd8af-f3b5-4fc4-8000-9b5dc4847cfc None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:02:15.632807 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfdd8af-f3b5-4fc4-8000-9b5dc4847cfc None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:02:15.633107 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfdd8af-f3b5-4fc4-8000-9b5dc4847cfc None admin] PATH_INFO: `/v3/domains` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:02:15.633931 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bfdd8af-f3b5-4fc4-8000-9b5dc4847cfc None admin] RBAC: Adding query filter params (name=Default) {{(pid=81766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:02:15.634268 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bfdd8af-f3b5-4fc4-8000-9b5dc4847cfc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:02:15.635743 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bfdd8af-f3b5-4fc4-8000-9b5dc4847cfc None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:02:15.648239 dv-cinder-862365-1-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 408/807] 10.222.0.23 () {56 vars in 1109 bytes} [Fri Oct 28 19:02:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:02:15.706812 dv-cinder-862365-1-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 400/808] 10.222.0.23 () {58 vars in 1024 bytes} [Fri Oct 28 19:02:15 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 28 19:02:15.976475 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfdd8af-f3b5-4fc4-8000-9b5dc4847cfc None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:02:16.075889 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfdd8af-f3b5-4fc4-8000-9b5dc4847cfc None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:02:16.103619 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:02:16.109453 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee035931-24e1-40a3-b8d9-106833469e6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:02:16.110079 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee035931-24e1-40a3-b8d9-106833469e6f None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:02:16.110361 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee035931-24e1-40a3-b8d9-106833469e6f None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:02:16.110636 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee035931-24e1-40a3-b8d9-106833469e6f None admin] PATH_INFO: `/v3/domains/default` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:02:16.111722 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee035931-24e1-40a3-b8d9-106833469e6f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:02:16.113145 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee035931-24e1-40a3-b8d9-106833469e6f None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:02:16.114740 dv-cinder-862365-1-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 409/809] 10.222.0.23 () {56 vars in 1108 bytes} [Fri Oct 28 19:02:15 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:02:16.120613 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa50ebe2-9050-4471-8d27-7e709d9cc923 None None] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:02:16.205969 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:02:16.217964 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa50ebe2-9050-4471-8d27-7e709d9cc923 None None] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:02:16.252434 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6313aa-af8e-4a71-b324-32d69c2beb4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:02:16.253029 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6313aa-af8e-4a71-b324-32d69c2beb4b None admin] REQUEST_METHOD: `POST` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:02:16.253306 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6313aa-af8e-4a71-b324-32d69c2beb4b None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:02:16.253604 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6313aa-af8e-4a71-b324-32d69c2beb4b None admin] PATH_INFO: `/v3/users` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:02:16.254246 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6313aa-af8e-4a71-b324-32d69c2beb4b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:02:16.255693 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6313aa-af8e-4a71-b324-32d69c2beb4b None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:02:16.349051 dv-cinder-862365-1-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 401/810] 10.222.0.23 () {60 vars in 1132 bytes} [Fri Oct 28 19:02:16 2022] POST /identity/v3/users => generated 285 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 19:02:16.414561 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726c2df0-b657-472c-8073-e4a7f2e7a3c3 None None] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:02:16.414850 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726c2df0-b657-472c-8073-e4a7f2e7a3c3 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:02:16.415129 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726c2df0-b657-472c-8073-e4a7f2e7a3c3 None None] PATH_INFO: `/` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:02:16.416572 dv-cinder-862365-1-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 410/811] 10.222.0.23 () {54 vars in 927 bytes} [Fri Oct 28 19:02:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 19:02:16.422532 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e331a7d-9645-4114-b6a2-47f127a2b777 None None] REQUEST_METHOD: `POST` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:02:16.422825 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e331a7d-9645-4114-b6a2-47f127a2b777 None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:02:16.423104 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e331a7d-9645-4114-b6a2-47f127a2b777 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:02:16.442834 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.auth.core [None req-0e331a7d-9645-4114-b6a2-47f127a2b777 None None] MFA Rules not processed for user `ae863915635746d1ac19970949de4722`. Rule list: `[]` (Enabled: `True`). {{(pid=81765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:02:16.444056 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-0e331a7d-9645-4114-b6a2-47f127a2b777 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:02:16.515293 dv-cinder-862365-1-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 402/812] 10.222.0.23 () {58 vars in 1024 bytes} [Fri Oct 28 19:02:16 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 28 19:02:16.780150 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726c2df0-b657-472c-8073-e4a7f2e7a3c3 None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:02:16.881985 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726c2df0-b657-472c-8073-e4a7f2e7a3c3 None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:02:16.914255 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b25220-7a68-47eb-a1b6-a656e568cb3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:02:16.914869 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b25220-7a68-47eb-a1b6-a656e568cb3b None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:02:16.915146 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b25220-7a68-47eb-a1b6-a656e568cb3b None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:02:16.915951 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b25220-7a68-47eb-a1b6-a656e568cb3b None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:02:16.926027 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b25220-7a68-47eb-a1b6-a656e568cb3b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 19:02:16.930753 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application [None req-e7b25220-7a68-47eb-a1b6-a656e568cb3b None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 28 19:02:16.930753 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 19:02:16.930753 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 19:02:16.930753 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 19:02:16.930753 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 19:02:16.930753 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 19:02:16.930753 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 19:02:16.930753 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 19:02:16.930753 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 19:02:16.930753 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 19:02:16.930753 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 19:02:16.930753 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 19:02:16.930753 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 28 19:02:16.930753 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 28 19:02:16.930753 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 28 19:02:16.930753 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 28 19:02:16.932222 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 28 19:02:16.932222 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 28 19:02:16.932222 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 28 19:02:16.932222 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 28 19:02:16.932222 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 19:02:16.932222 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 19:02:16.932222 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 19:02:16.932222 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 19:02:16.932222 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 19:02:16.932222 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 19:02:16.932222 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 19:02:16.932222 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application with Lock( Oct 28 19:02:16.932222 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 19:02:16.932222 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._enter() Oct 28 19:02:16.932222 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 19:02:16.932222 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 19:02:16.933049 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 19:02:16.933049 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.creator() Oct 28 19:02:16.933049 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 19:02:16.933049 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application created_value = creator( Oct 28 19:02:16.933049 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 28 19:02:16.933049 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 28 19:02:16.933049 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 28 19:02:16.933049 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 28 19:02:16.933049 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 28 19:02:16.933049 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 28 19:02:16.933049 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 28 19:02:16.933049 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Oct 28 19:02:16.933049 dv-cinder-862365-1-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 411/813] 10.222.0.23 () {56 vars in 1120 bytes} [Fri Oct 28 19:02:16 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 19:02:16.938540 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e331a7d-9645-4114-b6a2-47f127a2b777 None None] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:02:17.010578 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:02:17.035284 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e331a7d-9645-4114-b6a2-47f127a2b777 None None] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:02:17.070815 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51edea9d-51d1-4bc8-b8f2-c71bd8ec7549 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:02:17.071416 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51edea9d-51d1-4bc8-b8f2-c71bd8ec7549 None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:02:17.071695 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51edea9d-51d1-4bc8-b8f2-c71bd8ec7549 None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:02:17.071967 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51edea9d-51d1-4bc8-b8f2-c71bd8ec7549 None admin] PATH_INFO: `/v3/roles` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:02:17.072625 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51edea9d-51d1-4bc8-b8f2-c71bd8ec7549 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81765) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:02:17.072926 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51edea9d-51d1-4bc8-b8f2-c71bd8ec7549 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:02:17.074336 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51edea9d-51d1-4bc8-b8f2-c71bd8ec7549 None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:02:17.082538 dv-cinder-862365-1-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 403/814] 10.222.0.23 () {56 vars in 1115 bytes} [Fri Oct 28 19:02:16 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:02:17.089185 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b25220-7a68-47eb-a1b6-a656e568cb3b None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:02:17.145439 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:02:17.186262 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b25220-7a68-47eb-a1b6-a656e568cb3b None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:02:17.218895 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f483edf-0e75-4867-bf14-c5bd0f44f406 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:02:17.219514 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f483edf-0e75-4867-bf14-c5bd0f44f406 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:02:17.219795 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f483edf-0e75-4867-bf14-c5bd0f44f406 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:02:17.220064 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f483edf-0e75-4867-bf14-c5bd0f44f406 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:02:17.230810 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f483edf-0e75-4867-bf14-c5bd0f44f406 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:02:17.232247 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f483edf-0e75-4867-bf14-c5bd0f44f406 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:02:17.246085 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application [None req-1f483edf-0e75-4867-bf14-c5bd0f44f406 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 19:02:17.246085 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 19:02:17.246085 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 19:02:17.246085 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 19:02:17.246085 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 19:02:17.246085 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 19:02:17.246085 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 19:02:17.246085 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 19:02:17.246085 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 19:02:17.246085 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 19:02:17.246085 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 19:02:17.246085 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 19:02:17.246085 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 28 19:02:17.246085 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 28 19:02:17.246085 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 28 19:02:17.246085 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 28 19:02:17.247184 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 19:02:17.247184 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 19:02:17.247184 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 19:02:17.247184 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 19:02:17.247184 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 19:02:17.247184 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 19:02:17.247184 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 19:02:17.247184 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application with Lock( Oct 28 19:02:17.247184 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 19:02:17.247184 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._enter() Oct 28 19:02:17.247184 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 19:02:17.247184 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 19:02:17.247184 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 19:02:17.247184 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.creator() Oct 28 19:02:17.247184 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 19:02:17.247184 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application created_value = creator( Oct 28 19:02:17.247184 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 28 19:02:17.248073 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 28 19:02:17.248073 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 19:02:17.248073 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Oct 28 19:02:17.248073 dv-cinder-862365-1-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 412/815] 10.222.0.23 () {56 vars in 1108 bytes} [Fri Oct 28 19:02:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 19:02:17.252944 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51edea9d-51d1-4bc8-b8f2-c71bd8ec7549 None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:02:17.351511 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51edea9d-51d1-4bc8-b8f2-c71bd8ec7549 None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:02:17.383774 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52d6af8-6b66-4018-bcea-86486b1eb5cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:02:17.384904 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52d6af8-6b66-4018-bcea-86486b1eb5cd None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:02:17.385187 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52d6af8-6b66-4018-bcea-86486b1eb5cd None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:02:17.385493 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52d6af8-6b66-4018-bcea-86486b1eb5cd None admin] PATH_INFO: `/v3/domains` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:02:17.386130 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d52d6af8-6b66-4018-bcea-86486b1eb5cd None admin] RBAC: Adding query filter params (name=Default) {{(pid=81765) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:02:17.386434 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d52d6af8-6b66-4018-bcea-86486b1eb5cd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:02:17.387786 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d52d6af8-6b66-4018-bcea-86486b1eb5cd None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:02:17.390055 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:02:17.399350 dv-cinder-862365-1-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 404/816] 10.222.0.23 () {56 vars in 1109 bytes} [Fri Oct 28 19:02:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:02:17.405637 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f483edf-0e75-4867-bf14-c5bd0f44f406 None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:02:17.502268 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f483edf-0e75-4867-bf14-c5bd0f44f406 None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:02:17.512571 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:02:17.535438 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d71862e-0be0-4a98-9b64-ee54ad11d831 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:02:17.536054 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d71862e-0be0-4a98-9b64-ee54ad11d831 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:02:17.536334 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d71862e-0be0-4a98-9b64-ee54ad11d831 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:02:17.536608 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d71862e-0be0-4a98-9b64-ee54ad11d831 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:02:17.544066 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d71862e-0be0-4a98-9b64-ee54ad11d831 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:02:17.545784 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d71862e-0be0-4a98-9b64-ee54ad11d831 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:02:17.556623 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application [None req-2d71862e-0be0-4a98-9b64-ee54ad11d831 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 28 19:02:17.556623 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 19:02:17.556623 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 19:02:17.556623 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 19:02:17.556623 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 19:02:17.556623 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 19:02:17.556623 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 19:02:17.556623 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 19:02:17.556623 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 19:02:17.556623 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 19:02:17.556623 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 19:02:17.556623 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 19:02:17.556623 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 28 19:02:17.556623 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 28 19:02:17.556623 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 28 19:02:17.556623 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 28 19:02:17.557605 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 19:02:17.557605 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 19:02:17.557605 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 28 19:02:17.557605 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 28 19:02:17.557605 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 28 19:02:17.557605 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 28 19:02:17.557605 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 19:02:17.557605 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 19:02:17.557605 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 19:02:17.557605 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 19:02:17.557605 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 19:02:17.557605 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application with Lock( Oct 28 19:02:17.557605 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 19:02:17.557605 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._enter() Oct 28 19:02:17.557605 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 19:02:17.557605 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 19:02:17.557605 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 19:02:17.557605 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.creator() Oct 28 19:02:17.558541 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 19:02:17.558541 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application created_value = creator( Oct 28 19:02:17.558541 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 28 19:02:17.558541 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 28 19:02:17.558541 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 28 19:02:17.558541 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 28 19:02:17.558541 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 28 19:02:17.558541 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 28 19:02:17.558541 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 28 19:02:17.558541 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Oct 28 19:02:17.558541 dv-cinder-862365-1-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 413/817] 10.222.0.23 () {56 vars in 1093 bytes} [Fri Oct 28 19:02:17 2022] GET /identity/v3/users/nova => generated 82 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 19:02:17.563420 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52d6af8-6b66-4018-bcea-86486b1eb5cd None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:02:17.661765 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52d6af8-6b66-4018-bcea-86486b1eb5cd None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:02:17.693736 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c28721-f3cf-4fc9-afc3-73823c0ffb19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:02:17.694329 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c28721-f3cf-4fc9-afc3-73823c0ffb19 None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:02:17.694612 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c28721-f3cf-4fc9-afc3-73823c0ffb19 None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:02:17.694879 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c28721-f3cf-4fc9-afc3-73823c0ffb19 None admin] PATH_INFO: `/v3/users` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:02:17.695592 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c28721-f3cf-4fc9-afc3-73823c0ffb19 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81765) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:02:17.695894 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c28721-f3cf-4fc9-afc3-73823c0ffb19 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:02:17.697855 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c28721-f3cf-4fc9-afc3-73823c0ffb19 None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:02:17.714914 dv-cinder-862365-1-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 405/818] 10.222.0.23 () {56 vars in 1133 bytes} [Fri Oct 28 19:02:17 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:02:17.720683 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d71862e-0be0-4a98-9b64-ee54ad11d831 None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:02:17.816192 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d71862e-0be0-4a98-9b64-ee54ad11d831 None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:02:17.851282 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a520aa19-2635-49dd-94b0-958c25693a4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:02:17.851887 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a520aa19-2635-49dd-94b0-958c25693a4c None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:02:17.852169 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a520aa19-2635-49dd-94b0-958c25693a4c None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:02:17.852473 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a520aa19-2635-49dd-94b0-958c25693a4c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:02:17.892069 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:02:17.919077 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a520aa19-2635-49dd-94b0-958c25693a4c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:02:17.920497 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a520aa19-2635-49dd-94b0-958c25693a4c None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:02:18.018877 dv-cinder-862365-1-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 414/819] 10.222.0.23 () {58 vars in 1282 bytes} [Fri Oct 28 19:02:17 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 28 19:02:18.023263 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c28721-f3cf-4fc9-afc3-73823c0ffb19 None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:02:18.078543 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:02:18.122637 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c28721-f3cf-4fc9-afc3-73823c0ffb19 None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:02:18.155451 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46df97ea-618e-4a0e-9671-381adeac9b7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:02:18.156073 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46df97ea-618e-4a0e-9671-381adeac9b7a None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:02:18.156350 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46df97ea-618e-4a0e-9671-381adeac9b7a None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:02:18.156618 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46df97ea-618e-4a0e-9671-381adeac9b7a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:02:18.166848 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46df97ea-618e-4a0e-9671-381adeac9b7a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:02:18.168273 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46df97ea-618e-4a0e-9671-381adeac9b7a None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:02:18.295769 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application [None req-46df97ea-618e-4a0e-9671-381adeac9b7a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 19:02:18.295769 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 19:02:18.295769 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 19:02:18.295769 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 19:02:18.295769 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 19:02:18.295769 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 19:02:18.295769 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 19:02:18.295769 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 19:02:18.295769 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 19:02:18.295769 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 19:02:18.295769 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 19:02:18.295769 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 19:02:18.295769 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 28 19:02:18.295769 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 28 19:02:18.295769 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 28 19:02:18.295769 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 28 19:02:18.297426 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 19:02:18.297426 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 19:02:18.297426 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 19:02:18.297426 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 19:02:18.297426 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 19:02:18.297426 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 19:02:18.297426 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 19:02:18.297426 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application with Lock( Oct 28 19:02:18.297426 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 19:02:18.297426 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._enter() Oct 28 19:02:18.297426 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 19:02:18.297426 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 19:02:18.297426 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 19:02:18.297426 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.creator() Oct 28 19:02:18.297426 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 19:02:18.297426 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application created_value = creator( Oct 28 19:02:18.297426 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 28 19:02:18.298587 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 28 19:02:18.298587 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 19:02:18.298587 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application Oct 28 19:02:18.301607 dv-cinder-862365-1-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 406/820] 10.222.0.23 () {56 vars in 1108 bytes} [Fri Oct 28 19:02:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 279 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 19:02:18.302520 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a520aa19-2635-49dd-94b0-958c25693a4c None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:02:18.368572 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:02:18.401617 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a520aa19-2635-49dd-94b0-958c25693a4c None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:02:18.438563 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8a5b16-7c1e-4bf3-aaee-95d34d773864 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:02:18.439192 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8a5b16-7c1e-4bf3-aaee-95d34d773864 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:02:18.439475 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8a5b16-7c1e-4bf3-aaee-95d34d773864 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:02:18.439755 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8a5b16-7c1e-4bf3-aaee-95d34d773864 None admin] PATH_INFO: `/v3/domains` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:02:18.440432 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a8a5b16-7c1e-4bf3-aaee-95d34d773864 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:02:18.440737 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a8a5b16-7c1e-4bf3-aaee-95d34d773864 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:02:18.442283 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a8a5b16-7c1e-4bf3-aaee-95d34d773864 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:02:18.459151 dv-cinder-862365-1-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 415/821] 10.222.0.23 () {56 vars in 1109 bytes} [Fri Oct 28 19:02:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:02:18.460572 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46df97ea-618e-4a0e-9671-381adeac9b7a None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:02:18.538604 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789471ef-b71c-4ed9-9690-d425573fa0f4 None None] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:02:18.538893 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789471ef-b71c-4ed9-9690-d425573fa0f4 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:02:18.539173 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789471ef-b71c-4ed9-9690-d425573fa0f4 None None] PATH_INFO: `/` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:02:18.541140 dv-cinder-862365-1-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 416/822] 10.222.0.23 () {54 vars in 927 bytes} [Fri Oct 28 19:02:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 28 19:02:18.546047 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f248dc05-44a7-4777-ac11-43aef50f0e2a None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:02:18.546274 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f248dc05-44a7-4777-ac11-43aef50f0e2a None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:02:18.546550 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f248dc05-44a7-4777-ac11-43aef50f0e2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:02:18.559196 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46df97ea-618e-4a0e-9671-381adeac9b7a None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:02:18.564015 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-f248dc05-44a7-4777-ac11-43aef50f0e2a None None] MFA Rules not processed for user `ae863915635746d1ac19970949de4722`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:02:18.565196 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-f248dc05-44a7-4777-ac11-43aef50f0e2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:02:18.566384 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:02:18.593487 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c321504e-5abf-4aca-8653-5044d3dcdb7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:02:18.594108 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c321504e-5abf-4aca-8653-5044d3dcdb7e None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:02:18.594384 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c321504e-5abf-4aca-8653-5044d3dcdb7e None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:02:18.594649 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c321504e-5abf-4aca-8653-5044d3dcdb7e None admin] PATH_INFO: `/v3/projects/service` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:02:18.601308 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c321504e-5abf-4aca-8653-5044d3dcdb7e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:02:18.602824 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c321504e-5abf-4aca-8653-5044d3dcdb7e None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:02:18.614967 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application [None req-c321504e-5abf-4aca-8653-5044d3dcdb7e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 28 19:02:18.614967 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 19:02:18.614967 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 19:02:18.614967 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 19:02:18.614967 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 19:02:18.614967 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 19:02:18.614967 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 19:02:18.614967 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 19:02:18.614967 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 19:02:18.614967 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 19:02:18.614967 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 19:02:18.614967 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 19:02:18.614967 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 28 19:02:18.614967 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 28 19:02:18.614967 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 28 19:02:18.615894 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 28 19:02:18.615894 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 19:02:18.615894 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 19:02:18.615894 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 19:02:18.615894 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 19:02:18.615894 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 19:02:18.615894 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 19:02:18.615894 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 19:02:18.615894 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application with Lock( Oct 28 19:02:18.615894 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 19:02:18.615894 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._enter() Oct 28 19:02:18.615894 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 19:02:18.615894 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 19:02:18.615894 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 19:02:18.615894 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.creator() Oct 28 19:02:18.615894 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 19:02:18.615894 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application created_value = creator( Oct 28 19:02:18.616862 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 28 19:02:18.616862 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 28 19:02:18.616862 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 28 19:02:18.616862 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 28 19:02:18.616862 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 28 19:02:18.616862 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 28 19:02:18.616862 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 28 19:02:18.616862 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application Oct 28 19:02:18.616862 dv-cinder-862365-1-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 407/823] 10.222.0.23 () {56 vars in 1111 bytes} [Fri Oct 28 19:02:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 19:02:18.621890 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c321504e-5abf-4aca-8653-5044d3dcdb7e None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:02:18.636818 dv-cinder-862365-1-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 417/824] 10.222.0.23 () {58 vars in 1024 bytes} [Fri Oct 28 19:02:18 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 28 19:02:18.716320 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c321504e-5abf-4aca-8653-5044d3dcdb7e None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:02:18.748167 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72676095-7967-42c3-b09b-80a394941562 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:02:18.748753 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72676095-7967-42c3-b09b-80a394941562 None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:02:18.749026 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72676095-7967-42c3-b09b-80a394941562 None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:02:18.749297 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72676095-7967-42c3-b09b-80a394941562 None admin] PATH_INFO: `/v3/projects` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:02:18.749991 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72676095-7967-42c3-b09b-80a394941562 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81765) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:02:18.750294 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72676095-7967-42c3-b09b-80a394941562 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:02:18.751683 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72676095-7967-42c3-b09b-80a394941562 None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:02:18.763205 dv-cinder-862365-1-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 408/825] 10.222.0.23 () {56 vars in 1148 bytes} [Fri Oct 28 19:02:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 19:02:18.769084 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f248dc05-44a7-4777-ac11-43aef50f0e2a None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:02:18.838521 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:02:18.882734 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f248dc05-44a7-4777-ac11-43aef50f0e2a None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:02:18.902751 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72676095-7967-42c3-b09b-80a394941562 None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:02:18.917227 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499572a2-2a37-4f38-b1f3-dae3b605033b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:02:18.917854 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499572a2-2a37-4f38-b1f3-dae3b605033b None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:02:18.918179 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499572a2-2a37-4f38-b1f3-dae3b605033b None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:02:18.918486 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499572a2-2a37-4f38-b1f3-dae3b605033b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:02:18.919202 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499572a2-2a37-4f38-b1f3-dae3b605033b None admin] RBAC: Adding query filter params (role.id=2250592f6f214a5d8bf3c0a36c04f738, scope.project.id=b705897907f042c0818a931052438e1e, user.id=8877180cd9844dad8b0980de34769ec8) {{(pid=81766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:02:18.919505 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499572a2-2a37-4f38-b1f3-dae3b605033b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:02:18.920994 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499572a2-2a37-4f38-b1f3-dae3b605033b None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:02:18.927100 dv-cinder-862365-1-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 418/826] 10.222.0.23 () {56 vars in 1374 bytes} [Fri Oct 28 19:02:18 2022] GET /identity/v3/role_assignments?user.id=8877180cd9844dad8b0980de34769ec8&scope.project.id=b705897907f042c0818a931052438e1e&role.id=2250592f6f214a5d8bf3c0a36c04f738 => generated 608 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:02:18.929561 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:02:19.007864 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72676095-7967-42c3-b09b-80a394941562 None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:02:19.044213 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f66bb7-9b19-43bb-bbb3-d0b758924507 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:02:19.044865 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f66bb7-9b19-43bb-bbb3-d0b758924507 None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:02:19.045147 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f66bb7-9b19-43bb-bbb3-d0b758924507 None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:02:19.045450 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f66bb7-9b19-43bb-bbb3-d0b758924507 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:02:19.056905 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f66bb7-9b19-43bb-bbb3-d0b758924507 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 19:02:19.062612 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application [None req-49f66bb7-9b19-43bb-bbb3-d0b758924507 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 28 19:02:19.062612 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 19:02:19.062612 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 19:02:19.062612 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 19:02:19.062612 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 19:02:19.062612 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 19:02:19.062612 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 19:02:19.062612 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 19:02:19.062612 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 19:02:19.062612 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 19:02:19.062612 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 19:02:19.062612 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 19:02:19.062612 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 28 19:02:19.062612 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 28 19:02:19.062612 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 28 19:02:19.062612 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 28 19:02:19.064030 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 28 19:02:19.064030 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 28 19:02:19.064030 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 28 19:02:19.064030 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 28 19:02:19.064030 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 19:02:19.064030 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 19:02:19.064030 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 19:02:19.064030 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 19:02:19.064030 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 19:02:19.064030 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 19:02:19.064030 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 19:02:19.064030 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application with Lock( Oct 28 19:02:19.064030 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 19:02:19.064030 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._enter() Oct 28 19:02:19.064030 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 19:02:19.064030 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 19:02:19.065342 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 19:02:19.065342 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.creator() Oct 28 19:02:19.065342 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 19:02:19.065342 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application created_value = creator( Oct 28 19:02:19.065342 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 28 19:02:19.065342 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 28 19:02:19.065342 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 28 19:02:19.065342 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 28 19:02:19.065342 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 28 19:02:19.065342 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 28 19:02:19.065342 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 28 19:02:19.065342 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application Oct 28 19:02:19.065342 dv-cinder-862365-1-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 409/827] 10.222.0.23 () {56 vars in 1096 bytes} [Fri Oct 28 19:02:18 2022] GET /identity/v3/roles/admin => generated 83 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 28 19:02:19.070220 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499572a2-2a37-4f38-b1f3-dae3b605033b None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:02:19.180058 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499572a2-2a37-4f38-b1f3-dae3b605033b None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:02:19.203346 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:02:19.214512 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef45ce1-4aa1-41fa-b249-074144bad551 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:02:19.216010 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef45ce1-4aa1-41fa-b249-074144bad551 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:02:19.216010 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef45ce1-4aa1-41fa-b249-074144bad551 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:02:19.216010 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef45ce1-4aa1-41fa-b249-074144bad551 None admin] PATH_INFO: `/v3/roles` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:02:19.216412 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef45ce1-4aa1-41fa-b249-074144bad551 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:02:19.216709 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef45ce1-4aa1-41fa-b249-074144bad551 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:02:19.218169 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef45ce1-4aa1-41fa-b249-074144bad551 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:02:19.226933 dv-cinder-862365-1-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 419/828] 10.222.0.23 () {56 vars in 1099 bytes} [Fri Oct 28 19:02:19 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:02:19.233460 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f66bb7-9b19-43bb-bbb3-d0b758924507 None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:02:19.321015 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:02:19.335898 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f66bb7-9b19-43bb-bbb3-d0b758924507 None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:02:19.372010 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ec56ce-e4bf-4416-b6cb-99735641e59e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:02:19.372634 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ec56ce-e4bf-4416-b6cb-99735641e59e None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:02:19.372908 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ec56ce-e4bf-4416-b6cb-99735641e59e None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:02:19.373177 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ec56ce-e4bf-4416-b6cb-99735641e59e None admin] PATH_INFO: `/v3/users/8fa59cd29baf4e8e8320aa4c12ec6448` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:02:19.386299 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ec56ce-e4bf-4416-b6cb-99735641e59e None admin] RBAC: Authorizing `identity:get_user(user_id=8fa59cd29baf4e8e8320aa4c12ec6448)` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:02:19.387716 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ec56ce-e4bf-4416-b6cb-99735641e59e None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:02:19.389404 dv-cinder-862365-1-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 410/829] 10.222.0.23 () {56 vars in 1177 bytes} [Fri Oct 28 19:02:19 2022] GET /identity/v3/users/8fa59cd29baf4e8e8320aa4c12ec6448 => generated 285 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:02:19.395454 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef45ce1-4aa1-41fa-b249-074144bad551 None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:02:19.499147 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef45ce1-4aa1-41fa-b249-074144bad551 None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:02:19.533334 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c79759-deb4-4b11-ab17-bbbd41d08efb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:02:19.533986 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c79759-deb4-4b11-ab17-bbbd41d08efb None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:02:19.534260 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c79759-deb4-4b11-ab17-bbbd41d08efb None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:02:19.534532 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c79759-deb4-4b11-ab17-bbbd41d08efb None admin] PATH_INFO: `/v3/projects/7170fcff08f04cab858bbadb4b9be4dc` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:02:19.535635 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c79759-deb4-4b11-ab17-bbbd41d08efb None admin] RBAC: Authorizing `identity:get_project(project_id=7170fcff08f04cab858bbadb4b9be4dc)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:02:19.537039 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c79759-deb4-4b11-ab17-bbbd41d08efb None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:02:19.538680 dv-cinder-862365-1-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 420/830] 10.222.0.23 () {56 vars in 1186 bytes} [Fri Oct 28 19:02:19 2022] GET /identity/v3/projects/7170fcff08f04cab858bbadb4b9be4dc => generated 311 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:02:19.545191 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ec56ce-e4bf-4416-b6cb-99735641e59e None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:02:19.645496 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ec56ce-e4bf-4416-b6cb-99735641e59e None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:02:19.681727 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec443eb2-5d3d-4bd2-8a61-a618484cc401 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:02:19.682392 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec443eb2-5d3d-4bd2-8a61-a618484cc401 None admin] REQUEST_METHOD: `PUT` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:02:19.682678 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec443eb2-5d3d-4bd2-8a61-a618484cc401 None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:02:19.682954 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec443eb2-5d3d-4bd2-8a61-a618484cc401 None admin] PATH_INFO: `/v3/projects/7170fcff08f04cab858bbadb4b9be4dc/users/8fa59cd29baf4e8e8320aa4c12ec6448/roles/a9e4e47c2bf448fcbada91c1174644f7` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:02:19.687022 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec443eb2-5d3d-4bd2-8a61-a618484cc401 None admin] RBAC: Authorizing `identity:create_grant(project_id=7170fcff08f04cab858bbadb4b9be4dc, user_id=8fa59cd29baf4e8e8320aa4c12ec6448, role_id=a9e4e47c2bf448fcbada91c1174644f7)` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:02:19.688453 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec443eb2-5d3d-4bd2-8a61-a618484cc401 None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:02:19.808580 dv-cinder-862365-1-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 411/831] 10.222.0.23 () {58 vars in 1439 bytes} [Fri Oct 28 19:02:19 2022] PUT /identity/v3/projects/7170fcff08f04cab858bbadb4b9be4dc/users/8fa59cd29baf4e8e8320aa4c12ec6448/roles/a9e4e47c2bf448fcbada91c1174644f7 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 19:02:21.901074 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd5481e-4c83-41c6-a8a7-d57d953070ee None None] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:02:21.901617 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd5481e-4c83-41c6-a8a7-d57d953070ee None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:02:21.901715 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd5481e-4c83-41c6-a8a7-d57d953070ee None None] PATH_INFO: `/` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:02:21.902986 dv-cinder-862365-1-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 421/832] 10.222.0.23 () {54 vars in 927 bytes} [Fri Oct 28 19:02:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 19:02:21.908130 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207a1f91-2f31-40cb-80ca-cbc3eaae5c85 None None] REQUEST_METHOD: `POST` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:02:21.908567 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207a1f91-2f31-40cb-80ca-cbc3eaae5c85 None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:02:21.908667 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207a1f91-2f31-40cb-80ca-cbc3eaae5c85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:02:21.915819 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:02:21.926676 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.auth.core [None req-207a1f91-2f31-40cb-80ca-cbc3eaae5c85 None None] MFA Rules not processed for user `ae863915635746d1ac19970949de4722`. Rule list: `[]` (Enabled: `True`). {{(pid=81765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:02:21.931054 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-207a1f91-2f31-40cb-80ca-cbc3eaae5c85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:02:21.992869 dv-cinder-862365-1-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 412/833] 10.222.0.23 () {58 vars in 1024 bytes} [Fri Oct 28 19:02:21 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 28 19:02:22.256148 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd5481e-4c83-41c6-a8a7-d57d953070ee None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:02:22.310083 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:02:22.352831 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd5481e-4c83-41c6-a8a7-d57d953070ee None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:02:22.385896 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873931cf-1a6e-4e05-a355-e0eeddaa86b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:02:22.386503 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873931cf-1a6e-4e05-a355-e0eeddaa86b5 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:02:22.386783 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873931cf-1a6e-4e05-a355-e0eeddaa86b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:02:22.387049 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873931cf-1a6e-4e05-a355-e0eeddaa86b5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:02:22.397066 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873931cf-1a6e-4e05-a355-e0eeddaa86b5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 19:02:22.401906 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application [None req-873931cf-1a6e-4e05-a355-e0eeddaa86b5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 28 19:02:22.401906 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 19:02:22.401906 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 19:02:22.401906 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 19:02:22.401906 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 19:02:22.401906 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 19:02:22.401906 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 19:02:22.401906 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 19:02:22.401906 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 19:02:22.401906 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 19:02:22.401906 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 19:02:22.401906 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 19:02:22.401906 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 28 19:02:22.401906 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 28 19:02:22.401906 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 28 19:02:22.401906 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 28 19:02:22.403159 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 28 19:02:22.403159 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 28 19:02:22.403159 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 28 19:02:22.403159 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 28 19:02:22.403159 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 19:02:22.403159 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 19:02:22.403159 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 19:02:22.403159 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 19:02:22.403159 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 19:02:22.403159 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 19:02:22.403159 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 19:02:22.403159 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application with Lock( Oct 28 19:02:22.403159 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 19:02:22.403159 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._enter() Oct 28 19:02:22.403159 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 19:02:22.403159 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 19:02:22.404275 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 19:02:22.404275 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.creator() Oct 28 19:02:22.404275 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 19:02:22.404275 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application created_value = creator( Oct 28 19:02:22.404275 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 28 19:02:22.404275 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 28 19:02:22.404275 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 28 19:02:22.404275 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 28 19:02:22.404275 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 28 19:02:22.404275 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 28 19:02:22.404275 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 28 19:02:22.404275 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Oct 28 19:02:22.404275 dv-cinder-862365-1-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 422/834] 10.222.0.23 () {56 vars in 1096 bytes} [Fri Oct 28 19:02:22 2022] GET /identity/v3/roles/admin => generated 83 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 19:02:22.408995 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207a1f91-2f31-40cb-80ca-cbc3eaae5c85 None None] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:02:22.509021 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207a1f91-2f31-40cb-80ca-cbc3eaae5c85 None None] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:02:22.541653 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a564263e-0ced-4f08-a4a2-cde52e6b9452 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:02:22.542241 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a564263e-0ced-4f08-a4a2-cde52e6b9452 None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:02:22.542519 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a564263e-0ced-4f08-a4a2-cde52e6b9452 None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:02:22.542787 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a564263e-0ced-4f08-a4a2-cde52e6b9452 None admin] PATH_INFO: `/v3/roles` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:02:22.543432 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a564263e-0ced-4f08-a4a2-cde52e6b9452 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81765) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:02:22.543731 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a564263e-0ced-4f08-a4a2-cde52e6b9452 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:02:22.545071 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a564263e-0ced-4f08-a4a2-cde52e6b9452 None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:02:22.546388 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:02:22.553193 dv-cinder-862365-1-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 413/835] 10.222.0.23 () {56 vars in 1099 bytes} [Fri Oct 28 19:02:22 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:02:22.559941 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873931cf-1a6e-4e05-a355-e0eeddaa86b5 None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:02:22.656024 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873931cf-1a6e-4e05-a355-e0eeddaa86b5 None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:02:22.669786 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:02:22.689192 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25ac33b-1974-4ea9-b2a2-e24f45e030c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:02:22.689832 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25ac33b-1974-4ea9-b2a2-e24f45e030c5 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:02:22.690112 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25ac33b-1974-4ea9-b2a2-e24f45e030c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:02:22.690382 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25ac33b-1974-4ea9-b2a2-e24f45e030c5 None admin] PATH_INFO: `/v3/users/8fa59cd29baf4e8e8320aa4c12ec6448` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:02:22.691479 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e25ac33b-1974-4ea9-b2a2-e24f45e030c5 None admin] RBAC: Authorizing `identity:get_user(user_id=8fa59cd29baf4e8e8320aa4c12ec6448)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:02:22.692893 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e25ac33b-1974-4ea9-b2a2-e24f45e030c5 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:02:22.694488 dv-cinder-862365-1-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 423/836] 10.222.0.23 () {56 vars in 1177 bytes} [Fri Oct 28 19:02:22 2022] GET /identity/v3/users/8fa59cd29baf4e8e8320aa4c12ec6448 => generated 285 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 19:02:22.700170 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a564263e-0ced-4f08-a4a2-cde52e6b9452 None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:02:22.795166 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a564263e-0ced-4f08-a4a2-cde52e6b9452 None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:02:22.826918 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da387b5-efba-427b-a5fe-690f2f70b79a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:02:22.827508 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da387b5-efba-427b-a5fe-690f2f70b79a None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:02:22.827786 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da387b5-efba-427b-a5fe-690f2f70b79a None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:02:22.828053 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da387b5-efba-427b-a5fe-690f2f70b79a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:02:22.888400 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:02:22.894721 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da387b5-efba-427b-a5fe-690f2f70b79a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:02:22.896225 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da387b5-efba-427b-a5fe-690f2f70b79a None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:02:23.102469 dv-cinder-862365-1-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 414/837] 10.222.0.23 () {58 vars in 1282 bytes} [Fri Oct 28 19:02:22 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 403 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 28 19:02:23.108874 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25ac33b-1974-4ea9-b2a2-e24f45e030c5 None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:02:23.205326 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25ac33b-1974-4ea9-b2a2-e24f45e030c5 None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:02:23.239079 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21866c4b-7c5a-488c-899d-ee2a0c8530af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:02:23.239694 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21866c4b-7c5a-488c-899d-ee2a0c8530af None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:02:23.239975 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21866c4b-7c5a-488c-899d-ee2a0c8530af None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:02:23.240251 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21866c4b-7c5a-488c-899d-ee2a0c8530af None admin] PATH_INFO: `/v3/projects/7170fcff08f04cab858bbadb4b9be4dc` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:02:23.241379 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21866c4b-7c5a-488c-899d-ee2a0c8530af None admin] RBAC: Authorizing `identity:get_project(project_id=7170fcff08f04cab858bbadb4b9be4dc)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:02:23.242805 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21866c4b-7c5a-488c-899d-ee2a0c8530af None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:02:23.244444 dv-cinder-862365-1-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 424/838] 10.222.0.23 () {56 vars in 1186 bytes} [Fri Oct 28 19:02:23 2022] GET /identity/v3/projects/7170fcff08f04cab858bbadb4b9be4dc => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:02:23.250476 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da387b5-efba-427b-a5fe-690f2f70b79a None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:02:23.339415 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:02:23.344949 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da387b5-efba-427b-a5fe-690f2f70b79a None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:02:23.377819 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f330f7-df13-4e68-9342-9aaa7c82d352 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:02:23.378348 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f330f7-df13-4e68-9342-9aaa7c82d352 None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:02:23.378626 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f330f7-df13-4e68-9342-9aaa7c82d352 None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:02:23.378899 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f330f7-df13-4e68-9342-9aaa7c82d352 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:02:23.379613 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f330f7-df13-4e68-9342-9aaa7c82d352 None admin] RBAC: Adding query filter params (role.id=a9e4e47c2bf448fcbada91c1174644f7, scope.project.id=7170fcff08f04cab858bbadb4b9be4dc, user.id=8fa59cd29baf4e8e8320aa4c12ec6448) {{(pid=81765) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:02:23.379924 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f330f7-df13-4e68-9342-9aaa7c82d352 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:02:23.381337 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f330f7-df13-4e68-9342-9aaa7c82d352 None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:02:23.387405 dv-cinder-862365-1-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 415/839] 10.222.0.23 () {56 vars in 1374 bytes} [Fri Oct 28 19:02:23 2022] GET /identity/v3/role_assignments?user.id=8fa59cd29baf4e8e8320aa4c12ec6448&scope.project.id=7170fcff08f04cab858bbadb4b9be4dc&role.id=a9e4e47c2bf448fcbada91c1174644f7 => generated 608 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:02:25.511242 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c832848-313d-4d70-952d-40752dcf73e8 None None] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:02:25.511792 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c832848-313d-4d70-952d-40752dcf73e8 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:02:25.511792 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c832848-313d-4d70-952d-40752dcf73e8 None None] PATH_INFO: `/` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:02:25.513118 dv-cinder-862365-1-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 425/840] 10.222.0.23 () {54 vars in 927 bytes} [Fri Oct 28 19:02:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 19:02:25.518353 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f40ec2d-d37a-4e6c-92fb-9815134be872 None None] REQUEST_METHOD: `POST` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:02:25.518762 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f40ec2d-d37a-4e6c-92fb-9815134be872 None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:02:25.518906 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f40ec2d-d37a-4e6c-92fb-9815134be872 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:02:25.536953 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.auth.core [None req-1f40ec2d-d37a-4e6c-92fb-9815134be872 None None] MFA Rules not processed for user `ae863915635746d1ac19970949de4722`. Rule list: `[]` (Enabled: `True`). {{(pid=81765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:02:25.538148 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-1f40ec2d-d37a-4e6c-92fb-9815134be872 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:02:25.601269 dv-cinder-862365-1-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 416/841] 10.222.0.23 () {58 vars in 1024 bytes} [Fri Oct 28 19:02:25 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 28 19:02:25.867209 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c832848-313d-4d70-952d-40752dcf73e8 None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:02:25.917387 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:02:25.965933 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c832848-313d-4d70-952d-40752dcf73e8 None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:02:25.998845 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523d8d9f-4f0c-4985-8f3a-ca3bad61958e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:02:25.999455 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523d8d9f-4f0c-4985-8f3a-ca3bad61958e None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:02:25.999741 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523d8d9f-4f0c-4985-8f3a-ca3bad61958e None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:02:26.000014 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523d8d9f-4f0c-4985-8f3a-ca3bad61958e None admin] PATH_INFO: `/v3/domains/default` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:02:26.001113 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523d8d9f-4f0c-4985-8f3a-ca3bad61958e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:02:26.002563 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523d8d9f-4f0c-4985-8f3a-ca3bad61958e None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:02:26.004104 dv-cinder-862365-1-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 426/842] 10.222.0.23 () {56 vars in 1108 bytes} [Fri Oct 28 19:02:25 2022] GET /identity/v3/domains/default => generated 199 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:02:26.009806 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f40ec2d-d37a-4e6c-92fb-9815134be872 None None] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:02:26.096174 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:02:26.105844 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f40ec2d-d37a-4e6c-92fb-9815134be872 None None] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:02:26.139332 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886c6429-5451-4048-b613-b525ff1f03ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:02:26.139923 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886c6429-5451-4048-b613-b525ff1f03ca None admin] REQUEST_METHOD: `POST` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:02:26.140202 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886c6429-5451-4048-b613-b525ff1f03ca None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:02:26.140473 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886c6429-5451-4048-b613-b525ff1f03ca None admin] PATH_INFO: `/v3/users` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:02:26.141103 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-886c6429-5451-4048-b613-b525ff1f03ca None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:02:26.142553 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-886c6429-5451-4048-b613-b525ff1f03ca None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:02:26.230191 dv-cinder-862365-1-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 417/843] 10.222.0.23 () {60 vars in 1132 bytes} [Fri Oct 28 19:02:26 2022] POST /identity/v3/users => generated 286 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 19:02:28.392163 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914a65da-f61b-4089-9468-7913bcc97261 None None] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:02:28.392698 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914a65da-f61b-4089-9468-7913bcc97261 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:02:28.392698 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914a65da-f61b-4089-9468-7913bcc97261 None None] PATH_INFO: `/` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:02:28.394070 dv-cinder-862365-1-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 427/844] 10.222.0.23 () {54 vars in 927 bytes} [Fri Oct 28 19:02:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 19:02:28.399095 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558e71ef-bd0e-4ac4-950a-03a536bc97a6 None None] REQUEST_METHOD: `POST` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:02:28.399975 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558e71ef-bd0e-4ac4-950a-03a536bc97a6 None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:02:28.400242 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558e71ef-bd0e-4ac4-950a-03a536bc97a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:02:28.418542 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.auth.core [None req-558e71ef-bd0e-4ac4-950a-03a536bc97a6 None None] MFA Rules not processed for user `ae863915635746d1ac19970949de4722`. Rule list: `[]` (Enabled: `True`). {{(pid=81765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:02:28.419720 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-558e71ef-bd0e-4ac4-950a-03a536bc97a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:02:28.488936 dv-cinder-862365-1-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 418/845] 10.222.0.23 () {58 vars in 1024 bytes} [Fri Oct 28 19:02:28 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 28 19:02:28.755282 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914a65da-f61b-4089-9468-7913bcc97261 None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:02:28.856994 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914a65da-f61b-4089-9468-7913bcc97261 None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:02:28.874383 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:02:28.890984 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4334ed-8419-46be-b891-a58ec42176df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:02:28.891639 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4334ed-8419-46be-b891-a58ec42176df None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:02:28.891914 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4334ed-8419-46be-b891-a58ec42176df None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:02:28.892181 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4334ed-8419-46be-b891-a58ec42176df None admin] PATH_INFO: `/v3/roles/a11a1b300fe044b5a905284bc623dc41` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:02:28.893685 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4334ed-8419-46be-b891-a58ec42176df None admin] RBAC: Authorizing `identity:get_role(role_id=a11a1b300fe044b5a905284bc623dc41)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:02:28.895040 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4334ed-8419-46be-b891-a58ec42176df None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:02:28.896336 dv-cinder-862365-1-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 428/846] 10.222.0.23 () {56 vars in 1177 bytes} [Fri Oct 28 19:02:28 2022] GET /identity/v3/roles/a11a1b300fe044b5a905284bc623dc41 => generated 223 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:02:28.902657 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558e71ef-bd0e-4ac4-950a-03a536bc97a6 None None] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:02:28.974867 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:02:28.996948 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558e71ef-bd0e-4ac4-950a-03a536bc97a6 None None] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:02:29.029959 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5743ca0-71bb-47c0-9029-f556ce2d4e3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:02:29.030517 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5743ca0-71bb-47c0-9029-f556ce2d4e3b None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:02:29.030793 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5743ca0-71bb-47c0-9029-f556ce2d4e3b None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:02:29.031061 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5743ca0-71bb-47c0-9029-f556ce2d4e3b None admin] PATH_INFO: `/v3/users/d9011c674b9c4e5fbf1393ad5931e035` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:02:29.044487 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5743ca0-71bb-47c0-9029-f556ce2d4e3b None admin] RBAC: Authorizing `identity:get_user(user_id=d9011c674b9c4e5fbf1393ad5931e035)` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:02:29.045953 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5743ca0-71bb-47c0-9029-f556ce2d4e3b None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:02:29.047486 dv-cinder-862365-1-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 419/847] 10.222.0.23 () {56 vars in 1177 bytes} [Fri Oct 28 19:02:28 2022] GET /identity/v3/users/d9011c674b9c4e5fbf1393ad5931e035 => generated 286 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:02:29.053289 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4334ed-8419-46be-b891-a58ec42176df None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:02:29.262991 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4334ed-8419-46be-b891-a58ec42176df None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:02:29.295373 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d51dbe5-9240-4f45-90f0-7c0fc0568fc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:02:29.295923 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d51dbe5-9240-4f45-90f0-7c0fc0568fc7 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:02:29.296197 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d51dbe5-9240-4f45-90f0-7c0fc0568fc7 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:02:29.296464 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d51dbe5-9240-4f45-90f0-7c0fc0568fc7 None admin] PATH_INFO: `/v3/projects/7170fcff08f04cab858bbadb4b9be4dc` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:02:29.297645 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d51dbe5-9240-4f45-90f0-7c0fc0568fc7 None admin] RBAC: Authorizing `identity:get_project(project_id=7170fcff08f04cab858bbadb4b9be4dc)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:02:29.299023 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d51dbe5-9240-4f45-90f0-7c0fc0568fc7 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:02:29.300591 dv-cinder-862365-1-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 429/848] 10.222.0.23 () {56 vars in 1186 bytes} [Fri Oct 28 19:02:29 2022] GET /identity/v3/projects/7170fcff08f04cab858bbadb4b9be4dc => generated 311 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:02:29.306587 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5743ca0-71bb-47c0-9029-f556ce2d4e3b None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:02:29.402031 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5743ca0-71bb-47c0-9029-f556ce2d4e3b None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:02:29.434739 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376c49d3-2afe-4f00-aabf-3911f9068737 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:02:29.435379 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376c49d3-2afe-4f00-aabf-3911f9068737 None admin] REQUEST_METHOD: `PUT` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:02:29.435660 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376c49d3-2afe-4f00-aabf-3911f9068737 None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:02:29.435934 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376c49d3-2afe-4f00-aabf-3911f9068737 None admin] PATH_INFO: `/v3/projects/7170fcff08f04cab858bbadb4b9be4dc/users/d9011c674b9c4e5fbf1393ad5931e035/roles/a11a1b300fe044b5a905284bc623dc41` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:02:29.438097 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376c49d3-2afe-4f00-aabf-3911f9068737 None admin] RBAC: Authorizing `identity:create_grant(project_id=7170fcff08f04cab858bbadb4b9be4dc, user_id=d9011c674b9c4e5fbf1393ad5931e035, role_id=a11a1b300fe044b5a905284bc623dc41)` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:02:29.439511 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376c49d3-2afe-4f00-aabf-3911f9068737 None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:02:29.441667 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:02:29.515789 dv-cinder-862365-1-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 420/849] 10.222.0.23 () {58 vars in 1439 bytes} [Fri Oct 28 19:02:29 2022] PUT /identity/v3/projects/7170fcff08f04cab858bbadb4b9be4dc/users/d9011c674b9c4e5fbf1393ad5931e035/roles/a11a1b300fe044b5a905284bc623dc41 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 19:02:31.689511 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d99d3c-4a6a-4a98-ad1c-fe9836ce8f10 None None] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:02:31.690060 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d99d3c-4a6a-4a98-ad1c-fe9836ce8f10 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:02:31.690060 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d99d3c-4a6a-4a98-ad1c-fe9836ce8f10 None None] PATH_INFO: `/` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:02:31.691375 dv-cinder-862365-1-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 430/850] 10.222.0.23 () {54 vars in 927 bytes} [Fri Oct 28 19:02:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 19:02:31.697184 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197b5507-dfa2-45bf-aaa2-575c5b993936 None None] REQUEST_METHOD: `POST` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:02:31.697635 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197b5507-dfa2-45bf-aaa2-575c5b993936 None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:02:31.697776 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197b5507-dfa2-45bf-aaa2-575c5b993936 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:02:31.721828 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.auth.core [None req-197b5507-dfa2-45bf-aaa2-575c5b993936 None None] MFA Rules not processed for user `ae863915635746d1ac19970949de4722`. Rule list: `[]` (Enabled: `True`). {{(pid=81765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:02:31.723255 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-197b5507-dfa2-45bf-aaa2-575c5b993936 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:02:31.813423 dv-cinder-862365-1-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 421/851] 10.222.0.23 () {58 vars in 1024 bytes} [Fri Oct 28 19:02:31 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 28 19:02:32.101935 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d99d3c-4a6a-4a98-ad1c-fe9836ce8f10 None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:02:32.171513 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:02:32.232290 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d99d3c-4a6a-4a98-ad1c-fe9836ce8f10 None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:02:32.267483 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22f2c9b-3674-4456-b5eb-4c573e873e16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:02:32.268105 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22f2c9b-3674-4456-b5eb-4c573e873e16 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:02:32.268380 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22f2c9b-3674-4456-b5eb-4c573e873e16 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:02:32.268646 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22f2c9b-3674-4456-b5eb-4c573e873e16 None admin] PATH_INFO: `/v3/roles/a11a1b300fe044b5a905284bc623dc41` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:02:32.270039 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22f2c9b-3674-4456-b5eb-4c573e873e16 None admin] RBAC: Authorizing `identity:get_role(role_id=a11a1b300fe044b5a905284bc623dc41)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:02:32.271378 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22f2c9b-3674-4456-b5eb-4c573e873e16 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:02:32.272690 dv-cinder-862365-1-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 431/852] 10.222.0.23 () {56 vars in 1177 bytes} [Fri Oct 28 19:02:32 2022] GET /identity/v3/roles/a11a1b300fe044b5a905284bc623dc41 => generated 223 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:02:32.281806 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197b5507-dfa2-45bf-aaa2-575c5b993936 None None] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:02:32.394975 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197b5507-dfa2-45bf-aaa2-575c5b993936 None None] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:02:32.419850 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:02:32.430389 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5f1931-23c0-489a-86f8-c3ce24fa21d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:02:32.431117 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5f1931-23c0-489a-86f8-c3ce24fa21d7 None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:02:32.431436 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5f1931-23c0-489a-86f8-c3ce24fa21d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:02:32.431672 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5f1931-23c0-489a-86f8-c3ce24fa21d7 None admin] PATH_INFO: `/v3/users/d9011c674b9c4e5fbf1393ad5931e035` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:02:32.432789 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5f1931-23c0-489a-86f8-c3ce24fa21d7 None admin] RBAC: Authorizing `identity:get_user(user_id=d9011c674b9c4e5fbf1393ad5931e035)` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:02:32.434272 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5f1931-23c0-489a-86f8-c3ce24fa21d7 None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:02:32.435841 dv-cinder-862365-1-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 422/853] 10.222.0.23 () {56 vars in 1177 bytes} [Fri Oct 28 19:02:32 2022] GET /identity/v3/users/d9011c674b9c4e5fbf1393ad5931e035 => generated 286 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:02:32.441641 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22f2c9b-3674-4456-b5eb-4c573e873e16 None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:02:32.550335 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22f2c9b-3674-4456-b5eb-4c573e873e16 None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:02:32.572741 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:02:32.583885 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79bfd1e-e006-42d3-b8f8-d7c8ec540dc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:02:32.584483 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79bfd1e-e006-42d3-b8f8-d7c8ec540dc2 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:02:32.584763 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79bfd1e-e006-42d3-b8f8-d7c8ec540dc2 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:02:32.585033 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79bfd1e-e006-42d3-b8f8-d7c8ec540dc2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:02:32.653231 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79bfd1e-e006-42d3-b8f8-d7c8ec540dc2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:02:32.654713 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79bfd1e-e006-42d3-b8f8-d7c8ec540dc2 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:02:32.761326 dv-cinder-862365-1-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 432/854] 10.222.0.23 () {58 vars in 1282 bytes} [Fri Oct 28 19:02:32 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 28 19:02:32.767326 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5f1931-23c0-489a-86f8-c3ce24fa21d7 None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:02:32.863229 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5f1931-23c0-489a-86f8-c3ce24fa21d7 None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:02:32.897441 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc3c2ab-6c6b-4bcb-bf7c-7cf0360fee36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:02:32.898057 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc3c2ab-6c6b-4bcb-bf7c-7cf0360fee36 None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:02:32.898338 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc3c2ab-6c6b-4bcb-bf7c-7cf0360fee36 None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:02:32.898610 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc3c2ab-6c6b-4bcb-bf7c-7cf0360fee36 None admin] PATH_INFO: `/v3/projects/7170fcff08f04cab858bbadb4b9be4dc` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:02:32.899733 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc3c2ab-6c6b-4bcb-bf7c-7cf0360fee36 None admin] RBAC: Authorizing `identity:get_project(project_id=7170fcff08f04cab858bbadb4b9be4dc)` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:02:32.901149 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc3c2ab-6c6b-4bcb-bf7c-7cf0360fee36 None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:02:32.902776 dv-cinder-862365-1-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 423/855] 10.222.0.23 () {56 vars in 1186 bytes} [Fri Oct 28 19:02:32 2022] GET /identity/v3/projects/7170fcff08f04cab858bbadb4b9be4dc => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:02:32.909147 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79bfd1e-e006-42d3-b8f8-d7c8ec540dc2 None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:02:32.932388 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:02:33.006972 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79bfd1e-e006-42d3-b8f8-d7c8ec540dc2 None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:02:33.043776 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1e834d-0d16-4a09-8fc8-af62bb5a4ab5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:02:33.044388 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1e834d-0d16-4a09-8fc8-af62bb5a4ab5 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:02:33.044668 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1e834d-0d16-4a09-8fc8-af62bb5a4ab5 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:02:33.044941 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1e834d-0d16-4a09-8fc8-af62bb5a4ab5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:02:33.045698 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1e834d-0d16-4a09-8fc8-af62bb5a4ab5 None admin] RBAC: Adding query filter params (role.id=a11a1b300fe044b5a905284bc623dc41, scope.project.id=7170fcff08f04cab858bbadb4b9be4dc, user.id=d9011c674b9c4e5fbf1393ad5931e035) {{(pid=81766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:02:33.046006 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1e834d-0d16-4a09-8fc8-af62bb5a4ab5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:02:33.047428 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1e834d-0d16-4a09-8fc8-af62bb5a4ab5 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:02:33.053333 dv-cinder-862365-1-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 433/856] 10.222.0.23 () {56 vars in 1374 bytes} [Fri Oct 28 19:02:32 2022] GET /identity/v3/role_assignments?user.id=d9011c674b9c4e5fbf1393ad5931e035&scope.project.id=7170fcff08f04cab858bbadb4b9be4dc&role.id=a11a1b300fe044b5a905284bc623dc41 => generated 608 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:02:35.402631 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be3a3e5-3f52-45b6-9d76-95b0a9935021 None None] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:02:35.403164 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be3a3e5-3f52-45b6-9d76-95b0a9935021 None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:02:35.403164 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be3a3e5-3f52-45b6-9d76-95b0a9935021 None None] PATH_INFO: `/` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:02:35.404479 dv-cinder-862365-1-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 424/857] 10.222.0.23 () {54 vars in 927 bytes} [Fri Oct 28 19:02:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 19:02:35.409839 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f48b90-71cf-4000-b186-df748e90c297 None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:02:35.410239 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f48b90-71cf-4000-b186-df748e90c297 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:02:35.410394 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f48b90-71cf-4000-b186-df748e90c297 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:02:35.431186 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-c1f48b90-71cf-4000-b186-df748e90c297 None None] MFA Rules not processed for user `ae863915635746d1ac19970949de4722`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:02:35.433444 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-c1f48b90-71cf-4000-b186-df748e90c297 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:02:35.524091 dv-cinder-862365-1-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 434/858] 10.222.0.23 () {58 vars in 1024 bytes} [Fri Oct 28 19:02:35 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 28 19:02:35.845709 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be3a3e5-3f52-45b6-9d76-95b0a9935021 None None] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:02:35.915420 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:02:35.956805 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be3a3e5-3f52-45b6-9d76-95b0a9935021 None None] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:02:35.994101 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93286fd-f8d1-4abb-81ad-f44d4c8cc093 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:02:35.994720 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93286fd-f8d1-4abb-81ad-f44d4c8cc093 None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:02:35.994999 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93286fd-f8d1-4abb-81ad-f44d4c8cc093 None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:02:35.995271 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93286fd-f8d1-4abb-81ad-f44d4c8cc093 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:02:35.996367 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a93286fd-f8d1-4abb-81ad-f44d4c8cc093 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:02:35.997855 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a93286fd-f8d1-4abb-81ad-f44d4c8cc093 None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:02:35.999547 dv-cinder-862365-1-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 425/859] 10.222.0.23 () {56 vars in 1108 bytes} [Fri Oct 28 19:02:35 2022] GET /identity/v3/domains/default => generated 199 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:02:36.005476 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f48b90-71cf-4000-b186-df748e90c297 None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:02:36.024158 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:02:36.109115 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f48b90-71cf-4000-b186-df748e90c297 None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:02:36.143432 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7172bd-69f6-4420-920e-8152a695f404 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:02:36.144030 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7172bd-69f6-4420-920e-8152a695f404 None admin] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:02:36.144307 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7172bd-69f6-4420-920e-8152a695f404 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:02:36.144576 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7172bd-69f6-4420-920e-8152a695f404 None admin] PATH_INFO: `/v3/projects` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:02:36.145211 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff7172bd-69f6-4420-920e-8152a695f404 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:02:36.146648 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff7172bd-69f6-4420-920e-8152a695f404 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:02:36.235360 dv-cinder-862365-1-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 435/860] 10.222.0.23 () {60 vars in 1141 bytes} [Fri Oct 28 19:02:36 2022] POST /identity/v3/projects => generated 311 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 19:02:38.567588 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6896f1ce-c5c2-46c7-9b90-b5ca7a313dde None None] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:02:38.568121 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6896f1ce-c5c2-46c7-9b90-b5ca7a313dde None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:02:38.568121 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6896f1ce-c5c2-46c7-9b90-b5ca7a313dde None None] PATH_INFO: `/` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:02:38.569471 dv-cinder-862365-1-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 426/861] 10.222.0.23 () {54 vars in 927 bytes} [Fri Oct 28 19:02:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 19:02:38.575128 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceec936c-3be5-4370-aba2-2f6097b14f8e None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:02:38.575506 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceec936c-3be5-4370-aba2-2f6097b14f8e None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:02:38.575677 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceec936c-3be5-4370-aba2-2f6097b14f8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:02:38.594445 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-ceec936c-3be5-4370-aba2-2f6097b14f8e None None] MFA Rules not processed for user `ae863915635746d1ac19970949de4722`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:02:38.595624 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-ceec936c-3be5-4370-aba2-2f6097b14f8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:02:38.655528 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:02:38.660729 dv-cinder-862365-1-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 436/862] 10.222.0.23 () {58 vars in 1024 bytes} [Fri Oct 28 19:02:38 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 28 19:02:38.929334 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6896f1ce-c5c2-46c7-9b90-b5ca7a313dde None None] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:02:39.029440 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6896f1ce-c5c2-46c7-9b90-b5ca7a313dde None None] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:02:39.054058 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:02:39.061935 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086cfffb-c663-40c5-a745-d8e5601a4abd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:02:39.068083 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086cfffb-c663-40c5-a745-d8e5601a4abd None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:02:39.068083 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086cfffb-c663-40c5-a745-d8e5601a4abd None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:02:39.068083 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086cfffb-c663-40c5-a745-d8e5601a4abd None admin] PATH_INFO: `/v3/domains/default` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:02:39.068083 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086cfffb-c663-40c5-a745-d8e5601a4abd None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:02:39.068083 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086cfffb-c663-40c5-a745-d8e5601a4abd None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:02:39.068083 dv-cinder-862365-1-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 427/863] 10.222.0.23 () {56 vars in 1108 bytes} [Fri Oct 28 19:02:38 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:02:39.073490 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceec936c-3be5-4370-aba2-2f6097b14f8e None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:02:39.168357 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceec936c-3be5-4370-aba2-2f6097b14f8e None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:02:39.200666 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e57b1f-ba80-4642-ab41-0f413d1d8d80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:02:39.201256 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e57b1f-ba80-4642-ab41-0f413d1d8d80 None admin] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:02:39.201562 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e57b1f-ba80-4642-ab41-0f413d1d8d80 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:02:39.201836 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e57b1f-ba80-4642-ab41-0f413d1d8d80 None admin] PATH_INFO: `/v3/users` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:02:39.202487 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e57b1f-ba80-4642-ab41-0f413d1d8d80 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:02:39.203889 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e57b1f-ba80-4642-ab41-0f413d1d8d80 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:02:39.293721 dv-cinder-862365-1-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 437/864] 10.222.0.23 () {60 vars in 1132 bytes} [Fri Oct 28 19:02:39 2022] POST /identity/v3/users => generated 286 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 19:02:41.423773 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c970a54-fab7-4032-b388-e87fc34a28c9 None None] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:02:41.424300 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c970a54-fab7-4032-b388-e87fc34a28c9 None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:02:41.424300 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c970a54-fab7-4032-b388-e87fc34a28c9 None None] PATH_INFO: `/` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:02:41.425690 dv-cinder-862365-1-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 428/865] 10.222.0.23 () {54 vars in 927 bytes} [Fri Oct 28 19:02:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 19:02:41.430883 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b4508d-b4dd-4055-8908-3f2921eea071 None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:02:41.431291 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b4508d-b4dd-4055-8908-3f2921eea071 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:02:41.431427 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b4508d-b4dd-4055-8908-3f2921eea071 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:02:41.449872 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-53b4508d-b4dd-4055-8908-3f2921eea071 None None] MFA Rules not processed for user `ae863915635746d1ac19970949de4722`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:02:41.451040 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-53b4508d-b4dd-4055-8908-3f2921eea071 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:02:41.498351 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:02:41.515357 dv-cinder-862365-1-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 438/866] 10.222.0.23 () {58 vars in 1024 bytes} [Fri Oct 28 19:02:41 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 28 19:02:41.784269 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c970a54-fab7-4032-b388-e87fc34a28c9 None None] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:02:41.884599 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c970a54-fab7-4032-b388-e87fc34a28c9 None None] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:02:41.917457 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f828d24-9833-4772-9378-cf17429b4a37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:02:41.919361 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f828d24-9833-4772-9378-cf17429b4a37 None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:02:41.919361 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f828d24-9833-4772-9378-cf17429b4a37 None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:02:41.919361 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f828d24-9833-4772-9378-cf17429b4a37 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:02:41.928389 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f828d24-9833-4772-9378-cf17429b4a37 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 19:02:41.933873 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application [None req-6f828d24-9833-4772-9378-cf17429b4a37 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 28 19:02:41.933873 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 19:02:41.933873 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 19:02:41.933873 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 19:02:41.933873 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 19:02:41.933873 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 19:02:41.933873 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 19:02:41.933873 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 19:02:41.933873 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 19:02:41.933873 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 19:02:41.933873 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 19:02:41.933873 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 19:02:41.933873 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 28 19:02:41.933873 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 28 19:02:41.933873 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 28 19:02:41.933873 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 28 19:02:41.934947 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 28 19:02:41.934947 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 28 19:02:41.934947 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 28 19:02:41.934947 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 28 19:02:41.934947 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 19:02:41.934947 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 19:02:41.934947 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 19:02:41.934947 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 19:02:41.934947 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 19:02:41.934947 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 19:02:41.934947 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 19:02:41.934947 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application with Lock( Oct 28 19:02:41.934947 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 19:02:41.934947 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._enter() Oct 28 19:02:41.934947 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 19:02:41.934947 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 19:02:41.935812 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 19:02:41.935812 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.creator() Oct 28 19:02:41.935812 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 19:02:41.935812 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application created_value = creator( Oct 28 19:02:41.935812 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 28 19:02:41.935812 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 28 19:02:41.935812 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 28 19:02:41.935812 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 28 19:02:41.935812 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 28 19:02:41.935812 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 28 19:02:41.935812 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 28 19:02:41.935812 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application Oct 28 19:02:41.935812 dv-cinder-862365-1-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 429/867] 10.222.0.23 () {56 vars in 1096 bytes} [Fri Oct 28 19:02:41 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 19:02:41.940978 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b4508d-b4dd-4055-8908-3f2921eea071 None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:02:42.038518 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b4508d-b4dd-4055-8908-3f2921eea071 None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:02:42.071831 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c031a446-7309-4e47-8e6d-a7c4ce59d803 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:02:42.072426 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c031a446-7309-4e47-8e6d-a7c4ce59d803 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:02:42.072712 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c031a446-7309-4e47-8e6d-a7c4ce59d803 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:02:42.072987 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c031a446-7309-4e47-8e6d-a7c4ce59d803 None admin] PATH_INFO: `/v3/roles` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:02:42.073672 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c031a446-7309-4e47-8e6d-a7c4ce59d803 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:02:42.073977 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c031a446-7309-4e47-8e6d-a7c4ce59d803 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:02:42.075328 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c031a446-7309-4e47-8e6d-a7c4ce59d803 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:02:42.083012 dv-cinder-862365-1-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 439/868] 10.222.0.23 () {56 vars in 1099 bytes} [Fri Oct 28 19:02:41 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:02:42.089168 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f828d24-9833-4772-9378-cf17429b4a37 None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:02:42.143108 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:02:42.184918 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f828d24-9833-4772-9378-cf17429b4a37 None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:02:42.217252 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c86f96-4d4b-4b97-b858-2e7582113c33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:02:42.217890 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c86f96-4d4b-4b97-b858-2e7582113c33 None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:02:42.218168 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c86f96-4d4b-4b97-b858-2e7582113c33 None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:02:42.218437 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c86f96-4d4b-4b97-b858-2e7582113c33 None admin] PATH_INFO: `/v3/users/164f0760405742a69645dad423d075c5` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:02:42.230996 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c86f96-4d4b-4b97-b858-2e7582113c33 None admin] RBAC: Authorizing `identity:get_user(user_id=164f0760405742a69645dad423d075c5)` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:02:42.232411 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c86f96-4d4b-4b97-b858-2e7582113c33 None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:02:42.234004 dv-cinder-862365-1-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 430/869] 10.222.0.23 () {56 vars in 1177 bytes} [Fri Oct 28 19:02:42 2022] GET /identity/v3/users/164f0760405742a69645dad423d075c5 => generated 286 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:02:42.239654 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c031a446-7309-4e47-8e6d-a7c4ce59d803 None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:02:42.285670 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:02:42.337748 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c031a446-7309-4e47-8e6d-a7c4ce59d803 None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:02:42.369518 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d0bde8-5e7f-4a29-9fae-11915e6197a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:02:42.370132 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d0bde8-5e7f-4a29-9fae-11915e6197a3 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:02:42.370410 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d0bde8-5e7f-4a29-9fae-11915e6197a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:02:42.370806 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d0bde8-5e7f-4a29-9fae-11915e6197a3 None admin] PATH_INFO: `/v3/projects/ac08c504ec2c47b68f4473c9fd59911b` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:02:42.372016 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d0bde8-5e7f-4a29-9fae-11915e6197a3 None admin] RBAC: Authorizing `identity:get_project(project_id=ac08c504ec2c47b68f4473c9fd59911b)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:02:42.373475 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d0bde8-5e7f-4a29-9fae-11915e6197a3 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:02:42.375044 dv-cinder-862365-1-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 440/870] 10.222.0.23 () {56 vars in 1186 bytes} [Fri Oct 28 19:02:42 2022] GET /identity/v3/projects/ac08c504ec2c47b68f4473c9fd59911b => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:02:42.380966 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c86f96-4d4b-4b97-b858-2e7582113c33 None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:02:42.475166 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c86f96-4d4b-4b97-b858-2e7582113c33 None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:02:42.488238 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:02:42.507268 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105d983e-d465-4790-97e1-6e0eb53676f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:02:42.507903 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105d983e-d465-4790-97e1-6e0eb53676f8 None admin] REQUEST_METHOD: `PUT` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:02:42.508179 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105d983e-d465-4790-97e1-6e0eb53676f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:02:42.508449 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105d983e-d465-4790-97e1-6e0eb53676f8 None admin] PATH_INFO: `/v3/projects/ac08c504ec2c47b68f4473c9fd59911b/users/164f0760405742a69645dad423d075c5/roles/a9e4e47c2bf448fcbada91c1174644f7` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:02:42.510870 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105d983e-d465-4790-97e1-6e0eb53676f8 None admin] RBAC: Authorizing `identity:create_grant(project_id=ac08c504ec2c47b68f4473c9fd59911b, user_id=164f0760405742a69645dad423d075c5, role_id=a9e4e47c2bf448fcbada91c1174644f7)` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:02:42.512327 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105d983e-d465-4790-97e1-6e0eb53676f8 None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:02:42.579720 dv-cinder-862365-1-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 431/871] 10.222.0.23 () {58 vars in 1439 bytes} [Fri Oct 28 19:02:42 2022] PUT /identity/v3/projects/ac08c504ec2c47b68f4473c9fd59911b/users/164f0760405742a69645dad423d075c5/roles/a9e4e47c2bf448fcbada91c1174644f7 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 19:02:44.698993 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f88f90-5a45-445b-ac68-7c9160268ad7 None None] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:02:44.699580 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f88f90-5a45-445b-ac68-7c9160268ad7 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:02:44.699580 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f88f90-5a45-445b-ac68-7c9160268ad7 None None] PATH_INFO: `/` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:02:44.700878 dv-cinder-862365-1-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 441/872] 10.222.0.23 () {54 vars in 927 bytes} [Fri Oct 28 19:02:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 28 19:02:44.706156 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdc06b3-12bb-41eb-82d3-2e63722291e2 None None] REQUEST_METHOD: `POST` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:02:44.706571 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdc06b3-12bb-41eb-82d3-2e63722291e2 None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:02:44.706711 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdc06b3-12bb-41eb-82d3-2e63722291e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:02:44.725020 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.auth.core [None req-acdc06b3-12bb-41eb-82d3-2e63722291e2 None None] MFA Rules not processed for user `ae863915635746d1ac19970949de4722`. Rule list: `[]` (Enabled: `True`). {{(pid=81765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:02:44.726244 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-acdc06b3-12bb-41eb-82d3-2e63722291e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:02:44.790001 dv-cinder-862365-1-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 432/873] 10.222.0.23 () {58 vars in 1024 bytes} [Fri Oct 28 19:02:44 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 28 19:02:45.059596 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f88f90-5a45-445b-ac68-7c9160268ad7 None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:02:45.157864 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f88f90-5a45-445b-ac68-7c9160268ad7 None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:02:45.171249 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:02:45.190388 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88872dc4-81c9-4159-aad1-84636d11e468 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:02:45.191032 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88872dc4-81c9-4159-aad1-84636d11e468 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:02:45.191312 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88872dc4-81c9-4159-aad1-84636d11e468 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:02:45.191582 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88872dc4-81c9-4159-aad1-84636d11e468 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:02:45.202653 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88872dc4-81c9-4159-aad1-84636d11e468 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 19:02:45.207650 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application [None req-88872dc4-81c9-4159-aad1-84636d11e468 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 28 19:02:45.207650 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 19:02:45.207650 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 19:02:45.207650 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 19:02:45.207650 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 19:02:45.207650 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 19:02:45.207650 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 19:02:45.207650 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 19:02:45.207650 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 19:02:45.207650 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 19:02:45.207650 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 19:02:45.207650 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 19:02:45.207650 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 28 19:02:45.207650 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 28 19:02:45.207650 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 28 19:02:45.207650 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 28 19:02:45.208752 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 28 19:02:45.208752 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 28 19:02:45.208752 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 28 19:02:45.208752 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 28 19:02:45.208752 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 19:02:45.208752 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 19:02:45.208752 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 19:02:45.208752 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 19:02:45.208752 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 19:02:45.208752 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 19:02:45.208752 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 19:02:45.208752 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application with Lock( Oct 28 19:02:45.208752 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 19:02:45.208752 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._enter() Oct 28 19:02:45.208752 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 19:02:45.208752 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 19:02:45.209999 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 19:02:45.209999 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.creator() Oct 28 19:02:45.209999 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 19:02:45.209999 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application created_value = creator( Oct 28 19:02:45.209999 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 28 19:02:45.209999 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 28 19:02:45.209999 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 28 19:02:45.209999 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 28 19:02:45.209999 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 28 19:02:45.209999 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 28 19:02:45.209999 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 28 19:02:45.209999 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Oct 28 19:02:45.209999 dv-cinder-862365-1-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 442/874] 10.222.0.23 () {56 vars in 1096 bytes} [Fri Oct 28 19:02:45 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 19:02:45.215327 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acdc06b3-12bb-41eb-82d3-2e63722291e2 None None] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:02:45.309981 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acdc06b3-12bb-41eb-82d3-2e63722291e2 None None] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:02:45.312163 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:02:45.344086 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634a39d4-8619-45ae-ad9b-013c402d1688 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:02:45.344674 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634a39d4-8619-45ae-ad9b-013c402d1688 None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:02:45.344956 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634a39d4-8619-45ae-ad9b-013c402d1688 None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:02:45.345231 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634a39d4-8619-45ae-ad9b-013c402d1688 None admin] PATH_INFO: `/v3/roles` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:02:45.345915 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-634a39d4-8619-45ae-ad9b-013c402d1688 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81765) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:02:45.346224 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-634a39d4-8619-45ae-ad9b-013c402d1688 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:02:45.347579 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-634a39d4-8619-45ae-ad9b-013c402d1688 None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:02:45.355272 dv-cinder-862365-1-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 433/875] 10.222.0.23 () {56 vars in 1099 bytes} [Fri Oct 28 19:02:45 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:02:45.361247 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88872dc4-81c9-4159-aad1-84636d11e468 None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:02:45.456570 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88872dc4-81c9-4159-aad1-84636d11e468 None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:02:45.488429 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b7bf4c-74b6-4766-8a3d-8318508b379b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:02:45.489039 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b7bf4c-74b6-4766-8a3d-8318508b379b None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:02:45.489317 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b7bf4c-74b6-4766-8a3d-8318508b379b None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:02:45.489619 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b7bf4c-74b6-4766-8a3d-8318508b379b None admin] PATH_INFO: `/v3/users/164f0760405742a69645dad423d075c5` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:02:45.490719 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b7bf4c-74b6-4766-8a3d-8318508b379b None admin] RBAC: Authorizing `identity:get_user(user_id=164f0760405742a69645dad423d075c5)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:02:45.492125 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b7bf4c-74b6-4766-8a3d-8318508b379b None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:02:45.494238 dv-cinder-862365-1-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 443/876] 10.222.0.23 () {56 vars in 1177 bytes} [Fri Oct 28 19:02:45 2022] GET /identity/v3/users/164f0760405742a69645dad423d075c5 => generated 286 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 19:02:45.499839 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634a39d4-8619-45ae-ad9b-013c402d1688 None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:02:45.596776 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634a39d4-8619-45ae-ad9b-013c402d1688 None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:02:45.628706 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259495a5-11e0-4304-8db2-38f8f2907c41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:02:45.629291 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259495a5-11e0-4304-8db2-38f8f2907c41 None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:02:45.629604 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259495a5-11e0-4304-8db2-38f8f2907c41 None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:02:45.629880 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259495a5-11e0-4304-8db2-38f8f2907c41 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:02:45.662022 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:02:45.693523 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259495a5-11e0-4304-8db2-38f8f2907c41 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:02:45.701745 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259495a5-11e0-4304-8db2-38f8f2907c41 None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:02:45.788228 dv-cinder-862365-1-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 434/877] 10.222.0.23 () {58 vars in 1282 bytes} [Fri Oct 28 19:02:45 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 289 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 28 19:02:45.795030 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b7bf4c-74b6-4766-8a3d-8318508b379b None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:02:45.836309 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:02:45.893393 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b7bf4c-74b6-4766-8a3d-8318508b379b None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:02:45.925678 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d905706-b434-49a7-8918-feb7cf3251ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:02:45.926294 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d905706-b434-49a7-8918-feb7cf3251ac None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:02:45.926574 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d905706-b434-49a7-8918-feb7cf3251ac None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:02:45.926845 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d905706-b434-49a7-8918-feb7cf3251ac None admin] PATH_INFO: `/v3/projects/ac08c504ec2c47b68f4473c9fd59911b` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:02:45.927946 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d905706-b434-49a7-8918-feb7cf3251ac None admin] RBAC: Authorizing `identity:get_project(project_id=ac08c504ec2c47b68f4473c9fd59911b)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:02:45.929382 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d905706-b434-49a7-8918-feb7cf3251ac None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:02:45.930989 dv-cinder-862365-1-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 444/878] 10.222.0.23 () {56 vars in 1186 bytes} [Fri Oct 28 19:02:45 2022] GET /identity/v3/projects/ac08c504ec2c47b68f4473c9fd59911b => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:02:45.937206 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259495a5-11e0-4304-8db2-38f8f2907c41 None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:02:45.998583 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:02:46.032307 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259495a5-11e0-4304-8db2-38f8f2907c41 None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:02:46.065358 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9123c5de-e432-4fdd-813f-0dbb4fda2ebc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:02:46.065967 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9123c5de-e432-4fdd-813f-0dbb4fda2ebc None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:02:46.066247 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9123c5de-e432-4fdd-813f-0dbb4fda2ebc None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:02:46.066522 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9123c5de-e432-4fdd-813f-0dbb4fda2ebc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:02:46.067236 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9123c5de-e432-4fdd-813f-0dbb4fda2ebc None admin] RBAC: Adding query filter params (role.id=a9e4e47c2bf448fcbada91c1174644f7, scope.project.id=ac08c504ec2c47b68f4473c9fd59911b, user.id=164f0760405742a69645dad423d075c5) {{(pid=81765) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:02:46.067545 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9123c5de-e432-4fdd-813f-0dbb4fda2ebc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:02:46.068962 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9123c5de-e432-4fdd-813f-0dbb4fda2ebc None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:02:46.075327 dv-cinder-862365-1-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 435/879] 10.222.0.23 () {56 vars in 1374 bytes} [Fri Oct 28 19:02:45 2022] GET /identity/v3/role_assignments?user.id=164f0760405742a69645dad423d075c5&scope.project.id=ac08c504ec2c47b68f4473c9fd59911b&role.id=a9e4e47c2bf448fcbada91c1174644f7 => generated 608 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:02:48.215104 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e75c339-94f5-4831-aad1-be2a607b944b None None] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:02:48.215603 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e75c339-94f5-4831-aad1-be2a607b944b None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:02:48.215603 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e75c339-94f5-4831-aad1-be2a607b944b None None] PATH_INFO: `/` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:02:48.216893 dv-cinder-862365-1-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 445/880] 10.222.0.23 () {54 vars in 927 bytes} [Fri Oct 28 19:02:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 19:02:48.222223 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d31124-90b1-4b17-8979-0d5e6c96cb70 None None] REQUEST_METHOD: `POST` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:02:48.222597 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d31124-90b1-4b17-8979-0d5e6c96cb70 None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:02:48.222772 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d31124-90b1-4b17-8979-0d5e6c96cb70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:02:48.240366 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.auth.core [None req-46d31124-90b1-4b17-8979-0d5e6c96cb70 None None] MFA Rules not processed for user `ae863915635746d1ac19970949de4722`. Rule list: `[]` (Enabled: `True`). {{(pid=81765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:02:48.241566 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-46d31124-90b1-4b17-8979-0d5e6c96cb70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:02:48.305672 dv-cinder-862365-1-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 436/881] 10.222.0.23 () {58 vars in 1024 bytes} [Fri Oct 28 19:02:48 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 28 19:02:48.575148 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e75c339-94f5-4831-aad1-be2a607b944b None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:02:48.673394 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e75c339-94f5-4831-aad1-be2a607b944b None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:02:48.683589 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:02:48.706770 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88de2704-0a13-418a-bc95-2665d2c9dfc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:02:48.707358 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88de2704-0a13-418a-bc95-2665d2c9dfc3 None admin] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:02:48.707642 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88de2704-0a13-418a-bc95-2665d2c9dfc3 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:02:48.707916 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88de2704-0a13-418a-bc95-2665d2c9dfc3 None admin] PATH_INFO: `/v3/domains` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:02:48.708573 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88de2704-0a13-418a-bc95-2665d2c9dfc3 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:02:48.710096 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88de2704-0a13-418a-bc95-2665d2c9dfc3 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:02:48.785710 dv-cinder-862365-1-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 446/882] 10.222.0.23 () {60 vars in 1138 bytes} [Fri Oct 28 19:02:48 2022] POST /identity/v3/domains => generated 267 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 19:02:50.950613 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70898d5-fc00-458a-9993-a43a40052041 None None] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:02:50.951174 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70898d5-fc00-458a-9993-a43a40052041 None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:02:50.951174 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70898d5-fc00-458a-9993-a43a40052041 None None] PATH_INFO: `/` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:02:50.952493 dv-cinder-862365-1-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 437/883] 10.222.0.23 () {54 vars in 927 bytes} [Fri Oct 28 19:02:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 19:02:50.957694 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e80a947-1406-46e0-840a-4def13207ffd None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:02:50.958113 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e80a947-1406-46e0-840a-4def13207ffd None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:02:50.958255 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e80a947-1406-46e0-840a-4def13207ffd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:02:50.976736 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-7e80a947-1406-46e0-840a-4def13207ffd None None] MFA Rules not processed for user `ae863915635746d1ac19970949de4722`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:02:50.978562 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-7e80a947-1406-46e0-840a-4def13207ffd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:02:51.043611 dv-cinder-862365-1-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 447/884] 10.222.0.23 () {58 vars in 1024 bytes} [Fri Oct 28 19:02:50 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 28 19:02:51.315088 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70898d5-fc00-458a-9993-a43a40052041 None None] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:02:51.374003 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:02:51.413855 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70898d5-fc00-458a-9993-a43a40052041 None None] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:02:51.446951 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bef61d4-526f-4334-a73e-d498389e084d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:02:51.447592 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bef61d4-526f-4334-a73e-d498389e084d None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:02:51.447874 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bef61d4-526f-4334-a73e-d498389e084d None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:02:51.448146 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bef61d4-526f-4334-a73e-d498389e084d None admin] PATH_INFO: `/v3/domains/33bbedaa750c4f678c0443c6776e082a` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:02:51.458282 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bef61d4-526f-4334-a73e-d498389e084d None admin] RBAC: Authorizing `identity:get_domain(domain_id=33bbedaa750c4f678c0443c6776e082a)` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:02:51.459713 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bef61d4-526f-4334-a73e-d498389e084d None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:02:51.461271 dv-cinder-862365-1-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 438/885] 10.222.0.23 () {56 vars in 1183 bytes} [Fri Oct 28 19:02:51 2022] GET /identity/v3/domains/33bbedaa750c4f678c0443c6776e082a => generated 267 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:02:51.467307 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e80a947-1406-46e0-840a-4def13207ffd None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:02:51.559929 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:02:51.562681 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e80a947-1406-46e0-840a-4def13207ffd None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:02:51.595812 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85230b5-4055-42f8-acff-d2dd910aaddd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:02:51.596351 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85230b5-4055-42f8-acff-d2dd910aaddd None admin] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:02:51.596629 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85230b5-4055-42f8-acff-d2dd910aaddd None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:02:51.596898 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85230b5-4055-42f8-acff-d2dd910aaddd None admin] PATH_INFO: `/v3/projects` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:02:51.597571 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85230b5-4055-42f8-acff-d2dd910aaddd None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:02:51.598982 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85230b5-4055-42f8-acff-d2dd910aaddd None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:02:51.693546 dv-cinder-862365-1-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 448/886] 10.222.0.23 () {60 vars in 1141 bytes} [Fri Oct 28 19:02:51 2022] POST /identity/v3/projects => generated 361 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 19:02:53.869129 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2666d5-d787-491c-af58-308e21942667 None None] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:02:53.869647 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2666d5-d787-491c-af58-308e21942667 None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:02:53.869746 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2666d5-d787-491c-af58-308e21942667 None None] PATH_INFO: `/` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:02:53.871059 dv-cinder-862365-1-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 439/887] 10.222.0.23 () {54 vars in 927 bytes} [Fri Oct 28 19:02:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 19:02:53.876420 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf86f82-f9b1-4e8d-816c-2095f023c596 None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:02:53.876858 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf86f82-f9b1-4e8d-816c-2095f023c596 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:02:53.876956 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf86f82-f9b1-4e8d-816c-2095f023c596 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:02:53.895037 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-ccf86f82-f9b1-4e8d-816c-2095f023c596 None None] MFA Rules not processed for user `ae863915635746d1ac19970949de4722`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:02:53.896193 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-ccf86f82-f9b1-4e8d-816c-2095f023c596 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:02:53.959048 dv-cinder-862365-1-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 449/888] 10.222.0.23 () {58 vars in 1024 bytes} [Fri Oct 28 19:02:53 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 28 19:02:54.229688 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2666d5-d787-491c-af58-308e21942667 None None] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:02:54.328990 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2666d5-d787-491c-af58-308e21942667 None None] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:02:54.348422 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:02:54.362258 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5cab3c2-0564-4189-be37-f510c66dbc8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:02:54.366921 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cab3c2-0564-4189-be37-f510c66dbc8a None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:02:54.366921 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cab3c2-0564-4189-be37-f510c66dbc8a None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:02:54.366921 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cab3c2-0564-4189-be37-f510c66dbc8a None admin] PATH_INFO: `/v3/domains/33bbedaa750c4f678c0443c6776e082a` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:02:54.366921 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5cab3c2-0564-4189-be37-f510c66dbc8a None admin] RBAC: Authorizing `identity:get_domain(domain_id=33bbedaa750c4f678c0443c6776e082a)` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:02:54.366921 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5cab3c2-0564-4189-be37-f510c66dbc8a None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:02:54.367455 dv-cinder-862365-1-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 440/889] 10.222.0.23 () {56 vars in 1183 bytes} [Fri Oct 28 19:02:54 2022] GET /identity/v3/domains/33bbedaa750c4f678c0443c6776e082a => generated 267 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:02:54.373780 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf86f82-f9b1-4e8d-816c-2095f023c596 None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:02:54.450734 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:02:54.467736 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf86f82-f9b1-4e8d-816c-2095f023c596 None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:02:54.500731 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0fd7abe-6c75-4dd9-aee9-6157ae75dbef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:02:54.501321 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fd7abe-6c75-4dd9-aee9-6157ae75dbef None admin] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:02:54.501635 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fd7abe-6c75-4dd9-aee9-6157ae75dbef None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:02:54.501903 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fd7abe-6c75-4dd9-aee9-6157ae75dbef None admin] PATH_INFO: `/v3/users` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:02:54.502531 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0fd7abe-6c75-4dd9-aee9-6157ae75dbef None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:02:54.503929 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0fd7abe-6c75-4dd9-aee9-6157ae75dbef None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:02:54.607167 dv-cinder-862365-1-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 450/890] 10.222.0.23 () {60 vars in 1132 bytes} [Fri Oct 28 19:02:54 2022] POST /identity/v3/users => generated 311 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 19:02:56.795661 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff457ad-8a9f-4769-8456-ffd5d744f925 None None] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:02:56.796192 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff457ad-8a9f-4769-8456-ffd5d744f925 None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:02:56.796192 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff457ad-8a9f-4769-8456-ffd5d744f925 None None] PATH_INFO: `/` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:02:56.797558 dv-cinder-862365-1-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 441/891] 10.222.0.23 () {54 vars in 927 bytes} [Fri Oct 28 19:02:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 19:02:56.802646 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3897846-1d6e-4bf7-bd9c-486b140a6544 None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:02:56.803036 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3897846-1d6e-4bf7-bd9c-486b140a6544 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:02:56.803186 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3897846-1d6e-4bf7-bd9c-486b140a6544 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:02:56.821064 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-a3897846-1d6e-4bf7-bd9c-486b140a6544 None None] MFA Rules not processed for user `ae863915635746d1ac19970949de4722`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:02:56.822269 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-a3897846-1d6e-4bf7-bd9c-486b140a6544 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:02:56.897669 dv-cinder-862365-1-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 451/892] 10.222.0.23 () {58 vars in 1024 bytes} [Fri Oct 28 19:02:56 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 28 19:02:57.161253 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff457ad-8a9f-4769-8456-ffd5d744f925 None None] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:02:57.259385 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff457ad-8a9f-4769-8456-ffd5d744f925 None None] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:02:57.291321 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b620cac9-c759-462d-acf4-673c2caa4d9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:02:57.291931 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b620cac9-c759-462d-acf4-673c2caa4d9a None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:02:57.292225 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b620cac9-c759-462d-acf4-673c2caa4d9a None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:02:57.292542 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b620cac9-c759-462d-acf4-673c2caa4d9a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:02:57.302559 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b620cac9-c759-462d-acf4-673c2caa4d9a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 19:02:57.307306 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application [None req-b620cac9-c759-462d-acf4-673c2caa4d9a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 28 19:02:57.307306 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 19:02:57.307306 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 19:02:57.307306 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 19:02:57.307306 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 19:02:57.307306 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 19:02:57.307306 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 19:02:57.307306 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 19:02:57.307306 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 19:02:57.307306 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 19:02:57.307306 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 19:02:57.307306 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 19:02:57.307306 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 28 19:02:57.307306 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 28 19:02:57.307306 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 28 19:02:57.307306 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 28 19:02:57.308451 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 28 19:02:57.308451 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 28 19:02:57.308451 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 28 19:02:57.308451 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 28 19:02:57.308451 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 19:02:57.308451 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 19:02:57.308451 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 19:02:57.308451 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 19:02:57.308451 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 19:02:57.308451 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 19:02:57.308451 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 19:02:57.308451 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application with Lock( Oct 28 19:02:57.308451 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 19:02:57.308451 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._enter() Oct 28 19:02:57.308451 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 19:02:57.308451 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 19:02:57.309568 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 19:02:57.309568 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.creator() Oct 28 19:02:57.309568 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 19:02:57.309568 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application created_value = creator( Oct 28 19:02:57.309568 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 28 19:02:57.309568 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 28 19:02:57.309568 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 28 19:02:57.309568 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 28 19:02:57.309568 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 28 19:02:57.309568 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 28 19:02:57.309568 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 28 19:02:57.309568 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application Oct 28 19:02:57.309568 dv-cinder-862365-1-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 442/893] 10.222.0.23 () {56 vars in 1096 bytes} [Fri Oct 28 19:02:57 2022] GET /identity/v3/roles/admin => generated 83 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 19:02:57.314434 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3897846-1d6e-4bf7-bd9c-486b140a6544 None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:02:57.377121 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:02:57.408790 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3897846-1d6e-4bf7-bd9c-486b140a6544 None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:02:57.440890 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036fa8a3-3c31-4392-a05e-5482aa2e4b26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:02:57.441454 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036fa8a3-3c31-4392-a05e-5482aa2e4b26 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:02:57.441732 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036fa8a3-3c31-4392-a05e-5482aa2e4b26 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:02:57.442002 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036fa8a3-3c31-4392-a05e-5482aa2e4b26 None admin] PATH_INFO: `/v3/roles` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:02:57.442651 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-036fa8a3-3c31-4392-a05e-5482aa2e4b26 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:02:57.443093 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-036fa8a3-3c31-4392-a05e-5482aa2e4b26 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:02:57.444453 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-036fa8a3-3c31-4392-a05e-5482aa2e4b26 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:02:57.453027 dv-cinder-862365-1-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 452/894] 10.222.0.23 () {56 vars in 1099 bytes} [Fri Oct 28 19:02:57 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:02:57.458743 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b620cac9-c759-462d-acf4-673c2caa4d9a None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:02:57.506741 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:02:57.556372 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b620cac9-c759-462d-acf4-673c2caa4d9a None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:02:57.589208 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62fd2d22-b6f7-4947-b4a5-0a5fd6f799c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:02:57.589844 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fd2d22-b6f7-4947-b4a5-0a5fd6f799c1 None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:02:57.590128 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fd2d22-b6f7-4947-b4a5-0a5fd6f799c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:02:57.590405 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fd2d22-b6f7-4947-b4a5-0a5fd6f799c1 None admin] PATH_INFO: `/v3/users/8d64dd924be64209acf733c83a1631f2` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:02:57.602912 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62fd2d22-b6f7-4947-b4a5-0a5fd6f799c1 None admin] RBAC: Authorizing `identity:get_user(user_id=8d64dd924be64209acf733c83a1631f2)` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:02:57.604328 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62fd2d22-b6f7-4947-b4a5-0a5fd6f799c1 None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:02:57.605919 dv-cinder-862365-1-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 443/895] 10.222.0.23 () {56 vars in 1177 bytes} [Fri Oct 28 19:02:57 2022] GET /identity/v3/users/8d64dd924be64209acf733c83a1631f2 => generated 311 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:02:57.611549 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036fa8a3-3c31-4392-a05e-5482aa2e4b26 None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:02:57.708018 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036fa8a3-3c31-4392-a05e-5482aa2e4b26 None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:02:57.735798 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:02:57.741306 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c86edf0-7f25-49b9-95e6-6515d97f89e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:02:57.747200 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c86edf0-7f25-49b9-95e6-6515d97f89e5 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:02:57.747200 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c86edf0-7f25-49b9-95e6-6515d97f89e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:02:57.747200 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c86edf0-7f25-49b9-95e6-6515d97f89e5 None admin] PATH_INFO: `/v3/projects/16f59107683f4a0ebec9c17e5bd8c495` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:02:57.747200 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c86edf0-7f25-49b9-95e6-6515d97f89e5 None admin] RBAC: Authorizing `identity:get_project(project_id=16f59107683f4a0ebec9c17e5bd8c495)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:02:57.747200 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c86edf0-7f25-49b9-95e6-6515d97f89e5 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:02:57.747200 dv-cinder-862365-1-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 453/896] 10.222.0.23 () {56 vars in 1186 bytes} [Fri Oct 28 19:02:57 2022] GET /identity/v3/projects/16f59107683f4a0ebec9c17e5bd8c495 => generated 361 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:02:57.752382 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62fd2d22-b6f7-4947-b4a5-0a5fd6f799c1 None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:02:57.848218 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62fd2d22-b6f7-4947-b4a5-0a5fd6f799c1 None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:02:57.855894 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:02:57.881318 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0423cc6-dbe5-490f-8a9d-ec06a7294e29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:02:57.881990 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0423cc6-dbe5-490f-8a9d-ec06a7294e29 None admin] REQUEST_METHOD: `PUT` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:02:57.882267 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0423cc6-dbe5-490f-8a9d-ec06a7294e29 None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:02:57.882538 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0423cc6-dbe5-490f-8a9d-ec06a7294e29 None admin] PATH_INFO: `/v3/projects/16f59107683f4a0ebec9c17e5bd8c495/users/8d64dd924be64209acf733c83a1631f2/roles/a9e4e47c2bf448fcbada91c1174644f7` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:02:57.885151 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0423cc6-dbe5-490f-8a9d-ec06a7294e29 None admin] RBAC: Authorizing `identity:create_grant(project_id=16f59107683f4a0ebec9c17e5bd8c495, user_id=8d64dd924be64209acf733c83a1631f2, role_id=a9e4e47c2bf448fcbada91c1174644f7)` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:02:57.886907 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0423cc6-dbe5-490f-8a9d-ec06a7294e29 None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:02:57.964854 dv-cinder-862365-1-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 444/897] 10.222.0.23 () {58 vars in 1439 bytes} [Fri Oct 28 19:02:57 2022] PUT /identity/v3/projects/16f59107683f4a0ebec9c17e5bd8c495/users/8d64dd924be64209acf733c83a1631f2/roles/a9e4e47c2bf448fcbada91c1174644f7 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 19:03:00.066379 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc9a166-363b-4c87-b711-2e599403b08f None None] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:03:00.066941 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc9a166-363b-4c87-b711-2e599403b08f None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:03:00.066941 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc9a166-363b-4c87-b711-2e599403b08f None None] PATH_INFO: `/` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:03:00.068241 dv-cinder-862365-1-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 454/898] 10.222.0.23 () {54 vars in 927 bytes} [Fri Oct 28 19:03:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 19:03:00.073580 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb645a54-7144-4f6b-a544-cf47fc18126e None None] REQUEST_METHOD: `POST` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:03:00.074019 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb645a54-7144-4f6b-a544-cf47fc18126e None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:03:00.074145 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb645a54-7144-4f6b-a544-cf47fc18126e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:03:00.092658 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.auth.core [None req-bb645a54-7144-4f6b-a544-cf47fc18126e None None] MFA Rules not processed for user `ae863915635746d1ac19970949de4722`. Rule list: `[]` (Enabled: `True`). {{(pid=81765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:03:00.093918 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-bb645a54-7144-4f6b-a544-cf47fc18126e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:03:00.158603 dv-cinder-862365-1-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 445/899] 10.222.0.23 () {58 vars in 1024 bytes} [Fri Oct 28 19:03:00 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 28 19:03:00.426099 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc9a166-363b-4c87-b711-2e599403b08f None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:03:00.531910 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc9a166-363b-4c87-b711-2e599403b08f None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:03:00.559005 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e512fddf-ad0b-44a3-b6f9-6bef2a8bd2c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:03:00.559618 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e512fddf-ad0b-44a3-b6f9-6bef2a8bd2c8 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:03:00.559900 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e512fddf-ad0b-44a3-b6f9-6bef2a8bd2c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:03:00.560170 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e512fddf-ad0b-44a3-b6f9-6bef2a8bd2c8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:03:00.573762 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e512fddf-ad0b-44a3-b6f9-6bef2a8bd2c8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 19:03:00.578922 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application [None req-e512fddf-ad0b-44a3-b6f9-6bef2a8bd2c8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 28 19:03:00.578922 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 19:03:00.578922 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 19:03:00.578922 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 19:03:00.578922 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 19:03:00.578922 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 19:03:00.578922 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 19:03:00.578922 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 19:03:00.578922 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 19:03:00.578922 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 19:03:00.578922 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 19:03:00.578922 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 19:03:00.578922 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 28 19:03:00.578922 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 28 19:03:00.578922 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 28 19:03:00.578922 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 28 19:03:00.580051 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 28 19:03:00.580051 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 28 19:03:00.580051 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 28 19:03:00.580051 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 28 19:03:00.580051 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 19:03:00.580051 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 19:03:00.580051 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 19:03:00.580051 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 19:03:00.580051 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 19:03:00.580051 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 19:03:00.580051 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 19:03:00.580051 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application with Lock( Oct 28 19:03:00.580051 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 19:03:00.580051 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._enter() Oct 28 19:03:00.580051 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 19:03:00.580051 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 19:03:00.581031 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 19:03:00.581031 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.creator() Oct 28 19:03:00.581031 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 19:03:00.581031 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application created_value = creator( Oct 28 19:03:00.581031 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 28 19:03:00.581031 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 28 19:03:00.581031 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 28 19:03:00.581031 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 28 19:03:00.581031 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 28 19:03:00.581031 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 28 19:03:00.581031 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 28 19:03:00.581031 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Oct 28 19:03:00.581031 dv-cinder-862365-1-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 455/900] 10.222.0.23 () {56 vars in 1096 bytes} [Fri Oct 28 19:03:00 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 19:03:00.586706 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb645a54-7144-4f6b-a544-cf47fc18126e None None] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:03:00.675487 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:03:00.680927 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb645a54-7144-4f6b-a544-cf47fc18126e None None] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:03:00.713889 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7d1ac1-1772-4320-bede-bf41408af9f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:03:00.714543 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7d1ac1-1772-4320-bede-bf41408af9f3 None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:03:00.714821 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7d1ac1-1772-4320-bede-bf41408af9f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:03:00.715092 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7d1ac1-1772-4320-bede-bf41408af9f3 None admin] PATH_INFO: `/v3/roles` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:03:00.715784 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7d1ac1-1772-4320-bede-bf41408af9f3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81765) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:03:00.716189 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7d1ac1-1772-4320-bede-bf41408af9f3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:03:00.717916 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7d1ac1-1772-4320-bede-bf41408af9f3 None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:03:00.726338 dv-cinder-862365-1-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 446/901] 10.222.0.23 () {56 vars in 1099 bytes} [Fri Oct 28 19:03:00 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:03:00.732778 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e512fddf-ad0b-44a3-b6f9-6bef2a8bd2c8 None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:03:00.788969 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:03:00.829941 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e512fddf-ad0b-44a3-b6f9-6bef2a8bd2c8 None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:03:00.863939 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4976c3d9-31a8-4919-9515-aca31dd2bc8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:03:00.864556 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4976c3d9-31a8-4919-9515-aca31dd2bc8d None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:03:00.864831 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4976c3d9-31a8-4919-9515-aca31dd2bc8d None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:03:00.865099 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4976c3d9-31a8-4919-9515-aca31dd2bc8d None admin] PATH_INFO: `/v3/users/8d64dd924be64209acf733c83a1631f2` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:03:00.866278 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4976c3d9-31a8-4919-9515-aca31dd2bc8d None admin] RBAC: Authorizing `identity:get_user(user_id=8d64dd924be64209acf733c83a1631f2)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:03:00.867712 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4976c3d9-31a8-4919-9515-aca31dd2bc8d None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:03:00.869259 dv-cinder-862365-1-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 456/902] 10.222.0.23 () {56 vars in 1177 bytes} [Fri Oct 28 19:03:00 2022] GET /identity/v3/users/8d64dd924be64209acf733c83a1631f2 => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:03:00.874972 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7d1ac1-1772-4320-bede-bf41408af9f3 None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:03:00.974358 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7d1ac1-1772-4320-bede-bf41408af9f3 None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:03:01.005451 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec7e2c1-880d-4b4c-a8bf-8e71e1b5c02f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:03:01.006043 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec7e2c1-880d-4b4c-a8bf-8e71e1b5c02f None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:03:01.006318 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec7e2c1-880d-4b4c-a8bf-8e71e1b5c02f None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:03:01.006587 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec7e2c1-880d-4b4c-a8bf-8e71e1b5c02f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:03:01.032735 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:03:01.071877 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec7e2c1-880d-4b4c-a8bf-8e71e1b5c02f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:03:01.074211 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec7e2c1-880d-4b4c-a8bf-8e71e1b5c02f None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:03:01.168424 dv-cinder-862365-1-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 447/903] 10.222.0.23 () {58 vars in 1282 bytes} [Fri Oct 28 19:03:00 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 28 19:03:01.174344 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4976c3d9-31a8-4919-9515-aca31dd2bc8d None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:03:01.271282 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4976c3d9-31a8-4919-9515-aca31dd2bc8d None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:03:01.296294 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:03:01.304544 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35af23e7-22aa-4ce7-9f47-4cdb5fe32ce9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:03:01.305195 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35af23e7-22aa-4ce7-9f47-4cdb5fe32ce9 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:03:01.305507 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35af23e7-22aa-4ce7-9f47-4cdb5fe32ce9 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:03:01.305835 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35af23e7-22aa-4ce7-9f47-4cdb5fe32ce9 None admin] PATH_INFO: `/v3/projects/16f59107683f4a0ebec9c17e5bd8c495` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:03:01.307000 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35af23e7-22aa-4ce7-9f47-4cdb5fe32ce9 None admin] RBAC: Authorizing `identity:get_project(project_id=16f59107683f4a0ebec9c17e5bd8c495)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:03:01.308429 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35af23e7-22aa-4ce7-9f47-4cdb5fe32ce9 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:03:01.310196 dv-cinder-862365-1-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 457/904] 10.222.0.23 () {56 vars in 1186 bytes} [Fri Oct 28 19:03:01 2022] GET /identity/v3/projects/16f59107683f4a0ebec9c17e5bd8c495 => generated 361 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:03:01.316430 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec7e2c1-880d-4b4c-a8bf-8e71e1b5c02f None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:03:01.372595 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:03:01.412264 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec7e2c1-880d-4b4c-a8bf-8e71e1b5c02f None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:03:01.444912 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460c0a8d-0053-49e8-b1b6-f72e0f9c85e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:03:01.445527 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460c0a8d-0053-49e8-b1b6-f72e0f9c85e2 None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:03:01.445832 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460c0a8d-0053-49e8-b1b6-f72e0f9c85e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:03:01.446104 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460c0a8d-0053-49e8-b1b6-f72e0f9c85e2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:03:01.446817 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460c0a8d-0053-49e8-b1b6-f72e0f9c85e2 None admin] RBAC: Adding query filter params (role.id=a9e4e47c2bf448fcbada91c1174644f7, scope.project.id=16f59107683f4a0ebec9c17e5bd8c495, user.id=8d64dd924be64209acf733c83a1631f2) {{(pid=81765) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:03:01.447124 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460c0a8d-0053-49e8-b1b6-f72e0f9c85e2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:03:01.448529 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460c0a8d-0053-49e8-b1b6-f72e0f9c85e2 None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:03:01.454166 dv-cinder-862365-1-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 448/905] 10.222.0.23 () {56 vars in 1374 bytes} [Fri Oct 28 19:03:01 2022] GET /identity/v3/role_assignments?user.id=8d64dd924be64209acf733c83a1631f2&scope.project.id=16f59107683f4a0ebec9c17e5bd8c495&role.id=a9e4e47c2bf448fcbada91c1174644f7 => generated 608 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:03:11.332841 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=3 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:03:11.451626 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=39 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:04:14.748792 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6742b9-d332-4f4f-b29f-27d09723e1e3 None None] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:04:14.749473 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6742b9-d332-4f4f-b29f-27d09723e1e3 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:04:14.749473 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6742b9-d332-4f4f-b29f-27d09723e1e3 None None] PATH_INFO: `/` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:04:14.750696 dv-cinder-862365-1-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 458/906] 10.222.0.23 () {54 vars in 927 bytes} [Fri Oct 28 19:04:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 19:04:14.755824 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97639e6a-134a-4590-a498-700a6bd0dd29 None None] REQUEST_METHOD: `POST` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:04:14.761588 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97639e6a-134a-4590-a498-700a6bd0dd29 None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:04:14.761588 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97639e6a-134a-4590-a498-700a6bd0dd29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:04:14.774811 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.auth.core [None req-97639e6a-134a-4590-a498-700a6bd0dd29 None None] MFA Rules not processed for user `ae863915635746d1ac19970949de4722`. Rule list: `[]` (Enabled: `True`). {{(pid=81765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:04:14.775989 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-97639e6a-134a-4590-a498-700a6bd0dd29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:04:14.842184 dv-cinder-862365-1-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 449/907] 10.222.0.23 () {58 vars in 1024 bytes} [Fri Oct 28 19:04:14 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 28 19:04:15.115604 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6742b9-d332-4f4f-b29f-27d09723e1e3 None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:04:15.218069 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6742b9-d332-4f4f-b29f-27d09723e1e3 None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:04:15.251276 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071ec5ae-ebdc-47b6-a651-19458d652c98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:04:15.251892 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071ec5ae-ebdc-47b6-a651-19458d652c98 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:04:15.252171 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071ec5ae-ebdc-47b6-a651-19458d652c98 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:04:15.252441 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071ec5ae-ebdc-47b6-a651-19458d652c98 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:04:15.262597 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071ec5ae-ebdc-47b6-a651-19458d652c98 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:04:15.264028 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071ec5ae-ebdc-47b6-a651-19458d652c98 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:04:15.280892 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application [None req-071ec5ae-ebdc-47b6-a651-19458d652c98 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 19:04:15.280892 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 19:04:15.280892 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 19:04:15.280892 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 19:04:15.280892 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 19:04:15.280892 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 19:04:15.280892 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 19:04:15.280892 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 19:04:15.280892 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 19:04:15.280892 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 19:04:15.280892 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 19:04:15.280892 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 19:04:15.280892 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 28 19:04:15.280892 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 28 19:04:15.280892 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 28 19:04:15.280892 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 28 19:04:15.282204 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 19:04:15.282204 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 19:04:15.282204 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 19:04:15.282204 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 19:04:15.282204 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 19:04:15.282204 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 19:04:15.282204 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 19:04:15.282204 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application with Lock( Oct 28 19:04:15.282204 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 19:04:15.282204 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._enter() Oct 28 19:04:15.282204 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 19:04:15.282204 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 19:04:15.282204 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 19:04:15.282204 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.creator() Oct 28 19:04:15.282204 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 19:04:15.282204 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application created_value = creator( Oct 28 19:04:15.282204 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 28 19:04:15.283200 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 28 19:04:15.283200 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 19:04:15.283200 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Oct 28 19:04:15.283200 dv-cinder-862365-1-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 459/908] 10.222.0.23 () {56 vars in 1108 bytes} [Fri Oct 28 19:04:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 19:04:15.288273 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97639e6a-134a-4590-a498-700a6bd0dd29 None None] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:04:15.385287 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97639e6a-134a-4590-a498-700a6bd0dd29 None None] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:04:15.412926 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:04:15.419276 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37adac1e-09ce-4dd6-ad4f-e8804002a627 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:04:15.419882 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37adac1e-09ce-4dd6-ad4f-e8804002a627 None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:04:15.420165 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37adac1e-09ce-4dd6-ad4f-e8804002a627 None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:04:15.420451 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37adac1e-09ce-4dd6-ad4f-e8804002a627 None admin] PATH_INFO: `/v3/domains` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:04:15.421137 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37adac1e-09ce-4dd6-ad4f-e8804002a627 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81765) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:04:15.421474 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37adac1e-09ce-4dd6-ad4f-e8804002a627 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:04:15.422835 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37adac1e-09ce-4dd6-ad4f-e8804002a627 None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:04:15.433846 dv-cinder-862365-1-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 450/909] 10.222.0.23 () {56 vars in 1109 bytes} [Fri Oct 28 19:04:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:04:15.441481 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071ec5ae-ebdc-47b6-a651-19458d652c98 None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:04:15.492735 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:04:15.539014 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071ec5ae-ebdc-47b6-a651-19458d652c98 None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:04:15.572459 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dbc77e5-ecc5-4f01-bc6f-1b74f51dc408 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:04:15.573049 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbc77e5-ecc5-4f01-bc6f-1b74f51dc408 None admin] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:04:15.573324 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbc77e5-ecc5-4f01-bc6f-1b74f51dc408 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:04:15.573623 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbc77e5-ecc5-4f01-bc6f-1b74f51dc408 None admin] PATH_INFO: `/v3/users` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:04:15.574260 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dbc77e5-ecc5-4f01-bc6f-1b74f51dc408 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:04:15.575700 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dbc77e5-ecc5-4f01-bc6f-1b74f51dc408 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:04:15.695168 dv-cinder-862365-1-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 460/910] 10.222.0.23 () {60 vars in 1132 bytes} [Fri Oct 28 19:04:15 2022] POST /identity/v3/users => generated 251 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 19:04:17.841253 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1add86-c94e-44bb-8971-5ece794d0543 None None] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:04:17.841831 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1add86-c94e-44bb-8971-5ece794d0543 None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:04:17.841831 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1add86-c94e-44bb-8971-5ece794d0543 None None] PATH_INFO: `/` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:04:17.843170 dv-cinder-862365-1-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 451/911] 10.222.0.23 () {54 vars in 927 bytes} [Fri Oct 28 19:04:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 19:04:17.848520 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd50a11-a028-47d4-bbc7-50f938d427a5 None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:04:17.849019 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd50a11-a028-47d4-bbc7-50f938d427a5 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:04:17.849111 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd50a11-a028-47d4-bbc7-50f938d427a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:04:17.867038 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-dfd50a11-a028-47d4-bbc7-50f938d427a5 None None] MFA Rules not processed for user `ae863915635746d1ac19970949de4722`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:04:17.868236 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-dfd50a11-a028-47d4-bbc7-50f938d427a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:04:17.932591 dv-cinder-862365-1-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 461/912] 10.222.0.23 () {58 vars in 1024 bytes} [Fri Oct 28 19:04:17 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 28 19:04:18.198634 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1add86-c94e-44bb-8971-5ece794d0543 None None] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:04:18.298137 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1add86-c94e-44bb-8971-5ece794d0543 None None] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:04:18.331127 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5e6639-6506-4e78-bb75-17066b545d06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:04:18.331747 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5e6639-6506-4e78-bb75-17066b545d06 None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:04:18.332027 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5e6639-6506-4e78-bb75-17066b545d06 None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:04:18.332300 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5e6639-6506-4e78-bb75-17066b545d06 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:04:18.343365 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5e6639-6506-4e78-bb75-17066b545d06 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 19:04:18.348090 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application [None req-4e5e6639-6506-4e78-bb75-17066b545d06 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 28 19:04:18.348090 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 19:04:18.348090 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 19:04:18.348090 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 19:04:18.348090 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 19:04:18.348090 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 19:04:18.348090 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 19:04:18.348090 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 19:04:18.348090 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 19:04:18.348090 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 19:04:18.348090 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 19:04:18.348090 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 19:04:18.348090 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 28 19:04:18.348090 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 28 19:04:18.348090 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 28 19:04:18.348090 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 28 19:04:18.349228 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 28 19:04:18.349228 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 28 19:04:18.349228 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 28 19:04:18.349228 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 28 19:04:18.349228 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 19:04:18.349228 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 19:04:18.349228 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 19:04:18.349228 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 19:04:18.349228 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 19:04:18.349228 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 19:04:18.349228 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 19:04:18.349228 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application with Lock( Oct 28 19:04:18.349228 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 19:04:18.349228 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._enter() Oct 28 19:04:18.349228 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 19:04:18.349228 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 19:04:18.350148 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 19:04:18.350148 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.creator() Oct 28 19:04:18.350148 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 19:04:18.350148 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application created_value = creator( Oct 28 19:04:18.350148 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 28 19:04:18.350148 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 28 19:04:18.350148 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 28 19:04:18.350148 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 28 19:04:18.350148 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 28 19:04:18.350148 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 28 19:04:18.350148 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 28 19:04:18.350148 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application Oct 28 19:04:18.350148 dv-cinder-862365-1-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 452/913] 10.222.0.23 () {56 vars in 1102 bytes} [Fri Oct 28 19:04:18 2022] GET /identity/v3/roles/service => generated 85 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 19:04:18.355237 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd50a11-a028-47d4-bbc7-50f938d427a5 None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:04:18.395952 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:04:18.453553 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd50a11-a028-47d4-bbc7-50f938d427a5 None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:04:18.487077 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc64fe8-51e6-45b2-8f6c-8443a673125d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:04:18.487671 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc64fe8-51e6-45b2-8f6c-8443a673125d None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:04:18.487951 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc64fe8-51e6-45b2-8f6c-8443a673125d None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:04:18.488222 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc64fe8-51e6-45b2-8f6c-8443a673125d None admin] PATH_INFO: `/v3/roles` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:04:18.488870 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc64fe8-51e6-45b2-8f6c-8443a673125d None admin] RBAC: Adding query filter params (name=service) {{(pid=81766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:04:18.489172 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc64fe8-51e6-45b2-8f6c-8443a673125d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:04:18.490566 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc64fe8-51e6-45b2-8f6c-8443a673125d None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:04:18.498325 dv-cinder-862365-1-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 462/914] 10.222.0.23 () {56 vars in 1103 bytes} [Fri Oct 28 19:04:18 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:04:18.504306 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5e6639-6506-4e78-bb75-17066b545d06 None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:04:18.553316 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:04:18.600935 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5e6639-6506-4e78-bb75-17066b545d06 None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:04:18.633439 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80653856-cbf6-439c-94d2-9dfbc9ac6149 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:04:18.634053 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80653856-cbf6-439c-94d2-9dfbc9ac6149 None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:04:18.634358 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80653856-cbf6-439c-94d2-9dfbc9ac6149 None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:04:18.634608 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80653856-cbf6-439c-94d2-9dfbc9ac6149 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:04:18.645303 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80653856-cbf6-439c-94d2-9dfbc9ac6149 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:04:18.646749 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80653856-cbf6-439c-94d2-9dfbc9ac6149 None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:04:18.660971 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application [None req-80653856-cbf6-439c-94d2-9dfbc9ac6149 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 19:04:18.660971 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 19:04:18.660971 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 19:04:18.660971 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 19:04:18.660971 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 19:04:18.660971 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 19:04:18.660971 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 19:04:18.660971 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 19:04:18.660971 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 19:04:18.660971 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 19:04:18.660971 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 19:04:18.660971 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 19:04:18.660971 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 28 19:04:18.660971 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 28 19:04:18.660971 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 28 19:04:18.660971 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 28 19:04:18.662098 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 19:04:18.662098 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 19:04:18.662098 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 19:04:18.662098 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 19:04:18.662098 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 19:04:18.662098 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 19:04:18.662098 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 19:04:18.662098 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application with Lock( Oct 28 19:04:18.662098 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 19:04:18.662098 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._enter() Oct 28 19:04:18.662098 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 19:04:18.662098 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 19:04:18.662098 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 19:04:18.662098 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.creator() Oct 28 19:04:18.662098 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 19:04:18.662098 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application created_value = creator( Oct 28 19:04:18.662098 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 28 19:04:18.663302 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 28 19:04:18.663302 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 19:04:18.663302 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application Oct 28 19:04:18.663302 dv-cinder-862365-1-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 453/915] 10.222.0.23 () {56 vars in 1108 bytes} [Fri Oct 28 19:04:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 19:04:18.667923 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc64fe8-51e6-45b2-8f6c-8443a673125d None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:04:18.764159 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:04:18.767070 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc64fe8-51e6-45b2-8f6c-8443a673125d None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:04:18.798981 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76163d6a-88a8-4441-a2a7-49fc617cdab6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:04:18.799576 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76163d6a-88a8-4441-a2a7-49fc617cdab6 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:04:18.799856 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76163d6a-88a8-4441-a2a7-49fc617cdab6 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:04:18.800155 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76163d6a-88a8-4441-a2a7-49fc617cdab6 None admin] PATH_INFO: `/v3/domains` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:04:18.800846 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76163d6a-88a8-4441-a2a7-49fc617cdab6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:04:18.801156 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76163d6a-88a8-4441-a2a7-49fc617cdab6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:04:18.802548 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76163d6a-88a8-4441-a2a7-49fc617cdab6 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:04:18.813904 dv-cinder-862365-1-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 463/916] 10.222.0.23 () {56 vars in 1109 bytes} [Fri Oct 28 19:04:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:04:18.819602 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80653856-cbf6-439c-94d2-9dfbc9ac6149 None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:04:18.920936 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80653856-cbf6-439c-94d2-9dfbc9ac6149 None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:04:18.922467 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:04:18.954754 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3006d519-5ac1-44f9-8c2e-fc4d473715e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:04:18.955390 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3006d519-5ac1-44f9-8c2e-fc4d473715e7 None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:04:18.955673 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3006d519-5ac1-44f9-8c2e-fc4d473715e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:04:18.955950 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3006d519-5ac1-44f9-8c2e-fc4d473715e7 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:04:18.963532 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3006d519-5ac1-44f9-8c2e-fc4d473715e7 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:04:18.964956 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3006d519-5ac1-44f9-8c2e-fc4d473715e7 None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:04:18.976508 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application [None req-3006d519-5ac1-44f9-8c2e-fc4d473715e7 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Oct 28 19:04:18.976508 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 19:04:18.976508 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 19:04:18.976508 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 19:04:18.976508 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 19:04:18.976508 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 19:04:18.976508 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 19:04:18.976508 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 19:04:18.976508 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 19:04:18.976508 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 19:04:18.976508 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 19:04:18.976508 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 19:04:18.976508 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 28 19:04:18.976508 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 28 19:04:18.976508 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 28 19:04:18.976508 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 28 19:04:18.977658 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 19:04:18.977658 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 19:04:18.977658 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 28 19:04:18.977658 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 28 19:04:18.977658 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 28 19:04:18.977658 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 28 19:04:18.977658 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 19:04:18.977658 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 19:04:18.977658 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 19:04:18.977658 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 19:04:18.977658 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 19:04:18.977658 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application with Lock( Oct 28 19:04:18.977658 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 19:04:18.977658 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._enter() Oct 28 19:04:18.977658 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 19:04:18.977658 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 19:04:18.977658 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 19:04:18.977658 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.creator() Oct 28 19:04:18.979115 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 19:04:18.979115 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application created_value = creator( Oct 28 19:04:18.979115 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 28 19:04:18.979115 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 28 19:04:18.979115 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 28 19:04:18.979115 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 28 19:04:18.979115 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 28 19:04:18.979115 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 28 19:04:18.979115 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Oct 28 19:04:18.979115 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application Oct 28 19:04:18.979115 dv-cinder-862365-1-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 454/917] 10.222.0.23 () {56 vars in 1108 bytes} [Fri Oct 28 19:04:18 2022] GET /identity/v3/users/placement => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 19:04:18.983534 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76163d6a-88a8-4441-a2a7-49fc617cdab6 None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:04:19.080526 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76163d6a-88a8-4441-a2a7-49fc617cdab6 None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:04:19.114475 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af147cb-2972-46a1-8d4a-fd74a9ac0537 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:04:19.115061 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af147cb-2972-46a1-8d4a-fd74a9ac0537 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:04:19.115338 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af147cb-2972-46a1-8d4a-fd74a9ac0537 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:04:19.115880 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af147cb-2972-46a1-8d4a-fd74a9ac0537 None admin] PATH_INFO: `/v3/users` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:04:19.116588 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af147cb-2972-46a1-8d4a-fd74a9ac0537 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:04:19.116887 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af147cb-2972-46a1-8d4a-fd74a9ac0537 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:04:19.118318 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af147cb-2972-46a1-8d4a-fd74a9ac0537 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:04:19.135143 dv-cinder-862365-1-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 464/918] 10.222.0.23 () {56 vars in 1143 bytes} [Fri Oct 28 19:04:18 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:04:19.141035 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3006d519-5ac1-44f9-8c2e-fc4d473715e7 None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:04:19.239128 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3006d519-5ac1-44f9-8c2e-fc4d473715e7 None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:04:19.272617 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a795f0-05f0-4cf1-815d-eb25d7059af7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:04:19.273232 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a795f0-05f0-4cf1-815d-eb25d7059af7 None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:04:19.273546 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a795f0-05f0-4cf1-815d-eb25d7059af7 None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:04:19.273818 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a795f0-05f0-4cf1-815d-eb25d7059af7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:04:19.283959 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a795f0-05f0-4cf1-815d-eb25d7059af7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:04:19.285476 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a795f0-05f0-4cf1-815d-eb25d7059af7 None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:04:19.299123 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application [None req-c6a795f0-05f0-4cf1-815d-eb25d7059af7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 19:04:19.299123 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 19:04:19.299123 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 19:04:19.299123 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 19:04:19.299123 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 19:04:19.299123 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 19:04:19.299123 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 19:04:19.299123 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 19:04:19.299123 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 19:04:19.299123 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 19:04:19.299123 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 19:04:19.299123 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 19:04:19.299123 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 28 19:04:19.299123 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 28 19:04:19.299123 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 28 19:04:19.299123 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 28 19:04:19.300228 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 19:04:19.300228 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 19:04:19.300228 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 19:04:19.300228 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 19:04:19.300228 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 19:04:19.300228 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 19:04:19.300228 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 19:04:19.300228 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application with Lock( Oct 28 19:04:19.300228 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 19:04:19.300228 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._enter() Oct 28 19:04:19.300228 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 19:04:19.300228 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 19:04:19.300228 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 19:04:19.300228 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.creator() Oct 28 19:04:19.300228 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 19:04:19.300228 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application created_value = creator( Oct 28 19:04:19.300228 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 28 19:04:19.301307 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 28 19:04:19.301307 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 19:04:19.301307 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application Oct 28 19:04:19.301307 dv-cinder-862365-1-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 455/919] 10.222.0.23 () {56 vars in 1108 bytes} [Fri Oct 28 19:04:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 28 19:04:19.306242 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af147cb-2972-46a1-8d4a-fd74a9ac0537 None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:04:19.326780 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:04:19.403858 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af147cb-2972-46a1-8d4a-fd74a9ac0537 None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:04:19.437892 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f15e7c-463b-4e4e-a437-054c74292eb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:04:19.438480 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f15e7c-463b-4e4e-a437-054c74292eb6 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:04:19.438755 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f15e7c-463b-4e4e-a437-054c74292eb6 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:04:19.439024 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f15e7c-463b-4e4e-a437-054c74292eb6 None admin] PATH_INFO: `/v3/domains` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:04:19.439650 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f15e7c-463b-4e4e-a437-054c74292eb6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:04:19.439949 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f15e7c-463b-4e4e-a437-054c74292eb6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:04:19.441309 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f15e7c-463b-4e4e-a437-054c74292eb6 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:04:19.452590 dv-cinder-862365-1-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 465/920] 10.222.0.23 () {56 vars in 1109 bytes} [Fri Oct 28 19:04:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:04:19.458516 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a795f0-05f0-4cf1-815d-eb25d7059af7 None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:04:19.474886 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:04:19.558888 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a795f0-05f0-4cf1-815d-eb25d7059af7 None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:04:19.592302 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4eb28f7-aea0-4276-8d00-6cc2ae58dd3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:04:19.592917 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4eb28f7-aea0-4276-8d00-6cc2ae58dd3a None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:04:19.593195 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4eb28f7-aea0-4276-8d00-6cc2ae58dd3a None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:04:19.593493 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4eb28f7-aea0-4276-8d00-6cc2ae58dd3a None admin] PATH_INFO: `/v3/projects/service` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:04:19.599957 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4eb28f7-aea0-4276-8d00-6cc2ae58dd3a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:04:19.601404 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4eb28f7-aea0-4276-8d00-6cc2ae58dd3a None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:04:19.613495 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application [None req-a4eb28f7-aea0-4276-8d00-6cc2ae58dd3a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 28 19:04:19.613495 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 19:04:19.613495 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 19:04:19.613495 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 19:04:19.613495 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 19:04:19.613495 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 19:04:19.613495 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 19:04:19.613495 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 19:04:19.613495 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 19:04:19.613495 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 19:04:19.613495 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 19:04:19.613495 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 19:04:19.613495 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 28 19:04:19.613495 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 28 19:04:19.613495 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 28 19:04:19.614564 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 28 19:04:19.614564 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 19:04:19.614564 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 19:04:19.614564 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 19:04:19.614564 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 19:04:19.614564 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 19:04:19.614564 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 19:04:19.614564 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 19:04:19.614564 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application with Lock( Oct 28 19:04:19.614564 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 19:04:19.614564 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._enter() Oct 28 19:04:19.614564 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 19:04:19.614564 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 19:04:19.614564 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 19:04:19.614564 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.creator() Oct 28 19:04:19.614564 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 19:04:19.614564 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application created_value = creator( Oct 28 19:04:19.615745 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 28 19:04:19.615745 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 28 19:04:19.615745 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 28 19:04:19.615745 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 28 19:04:19.615745 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 28 19:04:19.615745 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 28 19:04:19.615745 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 28 19:04:19.615745 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application Oct 28 19:04:19.615745 dv-cinder-862365-1-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 456/921] 10.222.0.23 () {56 vars in 1111 bytes} [Fri Oct 28 19:04:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 19:04:19.620430 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f15e7c-463b-4e4e-a437-054c74292eb6 None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:04:19.697855 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:04:19.719711 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f15e7c-463b-4e4e-a437-054c74292eb6 None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:04:19.755993 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ce7521-2d2c-43c0-b33b-107aa145433e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:04:19.756587 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ce7521-2d2c-43c0-b33b-107aa145433e None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:04:19.756866 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ce7521-2d2c-43c0-b33b-107aa145433e None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:04:19.757137 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ce7521-2d2c-43c0-b33b-107aa145433e None admin] PATH_INFO: `/v3/projects` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:04:19.757843 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ce7521-2d2c-43c0-b33b-107aa145433e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:04:19.758147 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ce7521-2d2c-43c0-b33b-107aa145433e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:04:19.759665 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ce7521-2d2c-43c0-b33b-107aa145433e None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:04:19.771349 dv-cinder-862365-1-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 466/922] 10.222.0.23 () {56 vars in 1148 bytes} [Fri Oct 28 19:04:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:04:19.777589 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4eb28f7-aea0-4276-8d00-6cc2ae58dd3a None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:04:19.852120 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:04:19.877006 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4eb28f7-aea0-4276-8d00-6cc2ae58dd3a None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:04:19.910445 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a119d7a8-fc22-4441-a24e-588eaffa3f33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:04:19.911099 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a119d7a8-fc22-4441-a24e-588eaffa3f33 None admin] REQUEST_METHOD: `PUT` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:04:19.911381 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a119d7a8-fc22-4441-a24e-588eaffa3f33 None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:04:19.911657 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a119d7a8-fc22-4441-a24e-588eaffa3f33 None admin] PATH_INFO: `/v3/projects/b705897907f042c0818a931052438e1e/users/c3308c9156d44c5599514ffaf708d4b3/roles/068b73485c0e46cb8a8d88b948028746` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:04:19.926176 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a119d7a8-fc22-4441-a24e-588eaffa3f33 None admin] RBAC: Authorizing `identity:create_grant(project_id=b705897907f042c0818a931052438e1e, user_id=c3308c9156d44c5599514ffaf708d4b3, role_id=068b73485c0e46cb8a8d88b948028746)` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:04:19.927604 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a119d7a8-fc22-4441-a24e-588eaffa3f33 None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:04:20.011750 dv-cinder-862365-1-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 457/923] 10.222.0.23 () {58 vars in 1439 bytes} [Fri Oct 28 19:04:19 2022] PUT /identity/v3/projects/b705897907f042c0818a931052438e1e/users/c3308c9156d44c5599514ffaf708d4b3/roles/068b73485c0e46cb8a8d88b948028746 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 19:04:22.142500 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6ccd28-3e57-4c2c-bca3-48996ed8fffa None None] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:04:22.143029 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6ccd28-3e57-4c2c-bca3-48996ed8fffa None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:04:22.143029 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6ccd28-3e57-4c2c-bca3-48996ed8fffa None None] PATH_INFO: `/` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:04:22.144397 dv-cinder-862365-1-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 467/924] 10.222.0.23 () {54 vars in 927 bytes} [Fri Oct 28 19:04:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 19:04:22.150022 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79515a50-559a-46e2-84e6-82fa4e04c436 None None] REQUEST_METHOD: `POST` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:04:22.150435 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79515a50-559a-46e2-84e6-82fa4e04c436 None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:04:22.150598 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79515a50-559a-46e2-84e6-82fa4e04c436 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:04:22.168298 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.auth.core [None req-79515a50-559a-46e2-84e6-82fa4e04c436 None None] MFA Rules not processed for user `ae863915635746d1ac19970949de4722`. Rule list: `[]` (Enabled: `True`). {{(pid=81765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:04:22.169506 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-79515a50-559a-46e2-84e6-82fa4e04c436 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:04:22.234295 dv-cinder-862365-1-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 458/925] 10.222.0.23 () {58 vars in 1024 bytes} [Fri Oct 28 19:04:22 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 28 19:04:22.507815 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6ccd28-3e57-4c2c-bca3-48996ed8fffa None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:04:22.609512 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6ccd28-3e57-4c2c-bca3-48996ed8fffa None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:04:22.642546 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc03df53-044a-4742-8286-4a06472a5b7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:04:22.643176 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc03df53-044a-4742-8286-4a06472a5b7d None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:04:22.643460 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc03df53-044a-4742-8286-4a06472a5b7d None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:04:22.643734 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc03df53-044a-4742-8286-4a06472a5b7d None admin] PATH_INFO: `/v3/roles/service` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:04:22.650288 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:04:22.653943 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc03df53-044a-4742-8286-4a06472a5b7d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 19:04:22.658801 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application [None req-dc03df53-044a-4742-8286-4a06472a5b7d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 28 19:04:22.658801 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 19:04:22.658801 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 19:04:22.658801 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 19:04:22.658801 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 19:04:22.658801 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 19:04:22.658801 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 19:04:22.658801 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 19:04:22.658801 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 19:04:22.658801 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 19:04:22.658801 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 19:04:22.658801 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 19:04:22.658801 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 28 19:04:22.658801 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 28 19:04:22.658801 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 28 19:04:22.658801 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 28 19:04:22.659974 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 28 19:04:22.659974 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 28 19:04:22.659974 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 28 19:04:22.659974 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 28 19:04:22.659974 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 19:04:22.659974 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 19:04:22.659974 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 19:04:22.659974 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 19:04:22.659974 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 19:04:22.659974 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 19:04:22.659974 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 19:04:22.659974 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application with Lock( Oct 28 19:04:22.659974 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 19:04:22.659974 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._enter() Oct 28 19:04:22.659974 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 19:04:22.659974 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 19:04:22.661011 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 19:04:22.661011 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.creator() Oct 28 19:04:22.661011 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 19:04:22.661011 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application created_value = creator( Oct 28 19:04:22.661011 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 28 19:04:22.661011 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 28 19:04:22.661011 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 28 19:04:22.661011 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 28 19:04:22.661011 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 28 19:04:22.661011 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 28 19:04:22.661011 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 28 19:04:22.661011 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Oct 28 19:04:22.661011 dv-cinder-862365-1-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 468/926] 10.222.0.23 () {56 vars in 1102 bytes} [Fri Oct 28 19:04:22 2022] GET /identity/v3/roles/service => generated 85 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 19:04:22.666258 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79515a50-559a-46e2-84e6-82fa4e04c436 None None] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:04:22.720774 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:04:22.764045 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79515a50-559a-46e2-84e6-82fa4e04c436 None None] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:04:22.796807 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654360bc-aa70-429e-bb72-36de8d2d73e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:04:22.797443 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654360bc-aa70-429e-bb72-36de8d2d73e4 None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:04:22.797730 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654360bc-aa70-429e-bb72-36de8d2d73e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:04:22.798007 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654360bc-aa70-429e-bb72-36de8d2d73e4 None admin] PATH_INFO: `/v3/roles` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:04:22.798663 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-654360bc-aa70-429e-bb72-36de8d2d73e4 None admin] RBAC: Adding query filter params (name=service) {{(pid=81765) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:04:22.798969 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-654360bc-aa70-429e-bb72-36de8d2d73e4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:04:22.800332 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-654360bc-aa70-429e-bb72-36de8d2d73e4 None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:04:22.808011 dv-cinder-862365-1-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 459/927] 10.222.0.23 () {56 vars in 1103 bytes} [Fri Oct 28 19:04:22 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:04:22.814581 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc03df53-044a-4742-8286-4a06472a5b7d None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:04:22.913698 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc03df53-044a-4742-8286-4a06472a5b7d None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:04:22.947581 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c50a792-fc87-46b5-a0ed-35ca5595e9fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:04:22.948258 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c50a792-fc87-46b5-a0ed-35ca5595e9fb None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:04:22.948542 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c50a792-fc87-46b5-a0ed-35ca5595e9fb None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:04:22.948814 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c50a792-fc87-46b5-a0ed-35ca5595e9fb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:04:22.958556 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c50a792-fc87-46b5-a0ed-35ca5595e9fb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:04:22.959990 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c50a792-fc87-46b5-a0ed-35ca5595e9fb None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:04:22.975880 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application [None req-9c50a792-fc87-46b5-a0ed-35ca5595e9fb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 19:04:22.975880 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 19:04:22.975880 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 19:04:22.975880 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 19:04:22.975880 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 19:04:22.975880 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 19:04:22.975880 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 19:04:22.975880 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 19:04:22.975880 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 19:04:22.975880 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 19:04:22.975880 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 19:04:22.975880 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 19:04:22.975880 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 28 19:04:22.975880 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 28 19:04:22.975880 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 28 19:04:22.975880 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 28 19:04:22.978767 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 19:04:22.978767 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 19:04:22.978767 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 19:04:22.978767 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 19:04:22.978767 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 19:04:22.978767 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 19:04:22.978767 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 19:04:22.978767 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application with Lock( Oct 28 19:04:22.978767 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 19:04:22.978767 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._enter() Oct 28 19:04:22.978767 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 19:04:22.978767 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 19:04:22.978767 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 19:04:22.978767 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.creator() Oct 28 19:04:22.978767 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 19:04:22.978767 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application created_value = creator( Oct 28 19:04:22.978767 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 28 19:04:22.979662 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 28 19:04:22.979662 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 19:04:22.979662 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Oct 28 19:04:22.979662 dv-cinder-862365-1-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 469/928] 10.222.0.23 () {56 vars in 1108 bytes} [Fri Oct 28 19:04:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 19:04:22.983502 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654360bc-aa70-429e-bb72-36de8d2d73e4 None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:04:23.080711 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654360bc-aa70-429e-bb72-36de8d2d73e4 None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:04:23.096610 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:04:23.114586 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0f444e-7f87-44a4-ae6e-97614069f41f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:04:23.115189 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0f444e-7f87-44a4-ae6e-97614069f41f None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:04:23.115475 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0f444e-7f87-44a4-ae6e-97614069f41f None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:04:23.115756 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0f444e-7f87-44a4-ae6e-97614069f41f None admin] PATH_INFO: `/v3/domains` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:04:23.116466 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf0f444e-7f87-44a4-ae6e-97614069f41f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81765) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:04:23.116764 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf0f444e-7f87-44a4-ae6e-97614069f41f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:04:23.118157 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf0f444e-7f87-44a4-ae6e-97614069f41f None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:04:23.129880 dv-cinder-862365-1-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 460/929] 10.222.0.23 () {56 vars in 1109 bytes} [Fri Oct 28 19:04:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:04:23.135553 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c50a792-fc87-46b5-a0ed-35ca5595e9fb None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:04:23.184844 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:04:23.232779 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c50a792-fc87-46b5-a0ed-35ca5595e9fb None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:04:23.266188 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fbd48ca-8808-4a6c-809f-3e5e8c9e368c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:04:23.266801 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbd48ca-8808-4a6c-809f-3e5e8c9e368c None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:04:23.267084 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbd48ca-8808-4a6c-809f-3e5e8c9e368c None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:04:23.267355 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbd48ca-8808-4a6c-809f-3e5e8c9e368c None admin] PATH_INFO: `/v3/users/placement` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:04:23.275287 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fbd48ca-8808-4a6c-809f-3e5e8c9e368c None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:04:23.280112 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fbd48ca-8808-4a6c-809f-3e5e8c9e368c None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:04:23.288156 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application [None req-3fbd48ca-8808-4a6c-809f-3e5e8c9e368c None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Oct 28 19:04:23.288156 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 19:04:23.288156 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 19:04:23.288156 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 19:04:23.288156 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 19:04:23.288156 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 19:04:23.288156 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 19:04:23.288156 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 19:04:23.288156 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 19:04:23.288156 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 19:04:23.288156 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 19:04:23.288156 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 19:04:23.288156 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 28 19:04:23.288156 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 28 19:04:23.288156 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 28 19:04:23.288156 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 28 19:04:23.289315 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 19:04:23.289315 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 19:04:23.289315 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 28 19:04:23.289315 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 28 19:04:23.289315 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 28 19:04:23.289315 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 28 19:04:23.289315 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 19:04:23.289315 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 19:04:23.289315 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 19:04:23.289315 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 19:04:23.289315 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 19:04:23.289315 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application with Lock( Oct 28 19:04:23.289315 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 19:04:23.289315 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._enter() Oct 28 19:04:23.289315 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 19:04:23.289315 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 19:04:23.289315 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 19:04:23.289315 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.creator() Oct 28 19:04:23.290298 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 19:04:23.290298 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application created_value = creator( Oct 28 19:04:23.290298 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 28 19:04:23.290298 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 28 19:04:23.290298 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 28 19:04:23.290298 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 28 19:04:23.290298 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 28 19:04:23.290298 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 28 19:04:23.290298 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Oct 28 19:04:23.290298 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Oct 28 19:04:23.290298 dv-cinder-862365-1-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 470/930] 10.222.0.23 () {56 vars in 1108 bytes} [Fri Oct 28 19:04:23 2022] GET /identity/v3/users/placement => generated 87 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 19:04:23.295020 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0f444e-7f87-44a4-ae6e-97614069f41f None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:04:23.394494 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0f444e-7f87-44a4-ae6e-97614069f41f None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:04:23.429652 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ef0c93-f9da-44a9-82de-afc826422468 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:04:23.430261 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ef0c93-f9da-44a9-82de-afc826422468 None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:04:23.430529 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ef0c93-f9da-44a9-82de-afc826422468 None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:04:23.430796 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ef0c93-f9da-44a9-82de-afc826422468 None admin] PATH_INFO: `/v3/users` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:04:23.431638 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ef0c93-f9da-44a9-82de-afc826422468 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81765) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:04:23.431934 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ef0c93-f9da-44a9-82de-afc826422468 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:04:23.433333 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ef0c93-f9da-44a9-82de-afc826422468 None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:04:23.450990 dv-cinder-862365-1-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 461/931] 10.222.0.23 () {56 vars in 1143 bytes} [Fri Oct 28 19:04:23 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:04:23.457288 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fbd48ca-8808-4a6c-809f-3e5e8c9e368c None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:04:23.554612 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fbd48ca-8808-4a6c-809f-3e5e8c9e368c None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:04:23.566477 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:04:23.589718 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2852411e-700c-428c-aa2b-277dfdd7e5c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:04:23.590865 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2852411e-700c-428c-aa2b-277dfdd7e5c7 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:04:23.591141 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2852411e-700c-428c-aa2b-277dfdd7e5c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:04:23.591411 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2852411e-700c-428c-aa2b-277dfdd7e5c7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:04:23.655868 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2852411e-700c-428c-aa2b-277dfdd7e5c7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:04:23.657283 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2852411e-700c-428c-aa2b-277dfdd7e5c7 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:04:23.755781 dv-cinder-862365-1-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 471/932] 10.222.0.23 () {58 vars in 1282 bytes} [Fri Oct 28 19:04:23 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 28 19:04:23.761608 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ef0c93-f9da-44a9-82de-afc826422468 None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:04:23.797122 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:04:23.861126 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ef0c93-f9da-44a9-82de-afc826422468 None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:04:23.895922 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e6cdb3-0b84-475a-b9f2-de7f660cc9a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:04:23.896535 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e6cdb3-0b84-475a-b9f2-de7f660cc9a3 None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:04:23.896848 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e6cdb3-0b84-475a-b9f2-de7f660cc9a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:04:23.897120 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e6cdb3-0b84-475a-b9f2-de7f660cc9a3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:04:23.907115 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e6cdb3-0b84-475a-b9f2-de7f660cc9a3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:04:23.908480 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e6cdb3-0b84-475a-b9f2-de7f660cc9a3 None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:04:23.922658 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application [None req-24e6cdb3-0b84-475a-b9f2-de7f660cc9a3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 19:04:23.922658 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 19:04:23.922658 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 19:04:23.922658 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 19:04:23.922658 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 19:04:23.922658 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 19:04:23.922658 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 19:04:23.922658 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 19:04:23.922658 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 19:04:23.922658 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 19:04:23.922658 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 19:04:23.922658 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 19:04:23.922658 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 28 19:04:23.922658 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 28 19:04:23.922658 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 28 19:04:23.922658 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 28 19:04:23.923657 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 19:04:23.923657 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 19:04:23.923657 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 19:04:23.923657 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 19:04:23.923657 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 19:04:23.923657 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 19:04:23.923657 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 19:04:23.923657 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application with Lock( Oct 28 19:04:23.923657 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 19:04:23.923657 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._enter() Oct 28 19:04:23.923657 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 19:04:23.923657 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 19:04:23.923657 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 19:04:23.923657 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.creator() Oct 28 19:04:23.923657 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 19:04:23.923657 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application created_value = creator( Oct 28 19:04:23.923657 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 28 19:04:23.924739 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 28 19:04:23.924739 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 19:04:23.924739 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application Oct 28 19:04:23.924739 dv-cinder-862365-1-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 462/933] 10.222.0.23 () {56 vars in 1108 bytes} [Fri Oct 28 19:04:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 19:04:23.929458 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2852411e-700c-428c-aa2b-277dfdd7e5c7 None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:04:23.941527 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:04:24.027005 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2852411e-700c-428c-aa2b-277dfdd7e5c7 None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:04:24.061003 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1e17a5-a2bb-4602-bec2-57baa790d363 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:04:24.061625 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1e17a5-a2bb-4602-bec2-57baa790d363 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:04:24.061909 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1e17a5-a2bb-4602-bec2-57baa790d363 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:04:24.062179 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1e17a5-a2bb-4602-bec2-57baa790d363 None admin] PATH_INFO: `/v3/domains` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:04:24.062808 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1e17a5-a2bb-4602-bec2-57baa790d363 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:04:24.063111 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1e17a5-a2bb-4602-bec2-57baa790d363 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:04:24.064501 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1e17a5-a2bb-4602-bec2-57baa790d363 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:04:24.075618 dv-cinder-862365-1-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 472/934] 10.222.0.23 () {56 vars in 1109 bytes} [Fri Oct 28 19:04:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:04:24.081082 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e6cdb3-0b84-475a-b9f2-de7f660cc9a3 None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:04:24.163966 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:04:24.178676 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e6cdb3-0b84-475a-b9f2-de7f660cc9a3 None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:04:24.210814 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40257f99-fb16-46bc-b0c8-01ace491caed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:04:24.211433 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40257f99-fb16-46bc-b0c8-01ace491caed None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:04:24.211713 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40257f99-fb16-46bc-b0c8-01ace491caed None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:04:24.211987 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40257f99-fb16-46bc-b0c8-01ace491caed None admin] PATH_INFO: `/v3/projects/service` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:04:24.218683 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40257f99-fb16-46bc-b0c8-01ace491caed None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:04:24.220103 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40257f99-fb16-46bc-b0c8-01ace491caed None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:04:24.231549 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application [None req-40257f99-fb16-46bc-b0c8-01ace491caed None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 28 19:04:24.231549 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 19:04:24.231549 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 19:04:24.231549 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 19:04:24.231549 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 19:04:24.231549 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 19:04:24.231549 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 19:04:24.231549 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 19:04:24.231549 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 19:04:24.231549 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 19:04:24.231549 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 19:04:24.231549 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 19:04:24.231549 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 28 19:04:24.231549 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 28 19:04:24.231549 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 28 19:04:24.232608 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 28 19:04:24.232608 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 19:04:24.232608 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 19:04:24.232608 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 19:04:24.232608 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 19:04:24.232608 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 19:04:24.232608 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 19:04:24.232608 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 19:04:24.232608 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application with Lock( Oct 28 19:04:24.232608 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 19:04:24.232608 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._enter() Oct 28 19:04:24.232608 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 19:04:24.232608 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 19:04:24.232608 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 19:04:24.232608 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.creator() Oct 28 19:04:24.232608 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 19:04:24.232608 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application created_value = creator( Oct 28 19:04:24.233713 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 28 19:04:24.233713 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 28 19:04:24.233713 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 28 19:04:24.233713 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 28 19:04:24.233713 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 28 19:04:24.233713 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 28 19:04:24.233713 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 28 19:04:24.233713 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application Oct 28 19:04:24.233713 dv-cinder-862365-1-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 463/935] 10.222.0.23 () {56 vars in 1111 bytes} [Fri Oct 28 19:04:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 19:04:24.238541 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1e17a5-a2bb-4602-bec2-57baa790d363 None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:04:24.306086 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:04:24.336984 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1e17a5-a2bb-4602-bec2-57baa790d363 None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:04:24.369060 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95071f52-956b-4cb8-8f92-9f2c386c596a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:04:24.369685 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95071f52-956b-4cb8-8f92-9f2c386c596a None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:04:24.369963 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95071f52-956b-4cb8-8f92-9f2c386c596a None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:04:24.370291 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95071f52-956b-4cb8-8f92-9f2c386c596a None admin] PATH_INFO: `/v3/projects` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:04:24.370965 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95071f52-956b-4cb8-8f92-9f2c386c596a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:04:24.371265 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95071f52-956b-4cb8-8f92-9f2c386c596a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:04:24.373195 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95071f52-956b-4cb8-8f92-9f2c386c596a None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:04:24.389514 dv-cinder-862365-1-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 473/936] 10.222.0.23 () {56 vars in 1148 bytes} [Fri Oct 28 19:04:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:04:24.391513 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40257f99-fb16-46bc-b0c8-01ace491caed None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:04:24.490121 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40257f99-fb16-46bc-b0c8-01ace491caed None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:04:24.523247 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6ea0f9-0e70-47e6-b210-7a8f266e3ed1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:04:24.523838 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6ea0f9-0e70-47e6-b210-7a8f266e3ed1 None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:04:24.524118 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6ea0f9-0e70-47e6-b210-7a8f266e3ed1 None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:04:24.524392 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6ea0f9-0e70-47e6-b210-7a8f266e3ed1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:04:24.525105 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6ea0f9-0e70-47e6-b210-7a8f266e3ed1 None admin] RBAC: Adding query filter params (role.id=068b73485c0e46cb8a8d88b948028746, scope.project.id=b705897907f042c0818a931052438e1e, user.id=c3308c9156d44c5599514ffaf708d4b3) {{(pid=81765) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:04:24.525441 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6ea0f9-0e70-47e6-b210-7a8f266e3ed1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:04:24.526857 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6ea0f9-0e70-47e6-b210-7a8f266e3ed1 None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:04:24.532449 dv-cinder-862365-1-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 464/937] 10.222.0.23 () {56 vars in 1374 bytes} [Fri Oct 28 19:04:24 2022] GET /identity/v3/role_assignments?user.id=c3308c9156d44c5599514ffaf708d4b3&scope.project.id=b705897907f042c0818a931052438e1e&role.id=068b73485c0e46cb8a8d88b948028746 => generated 608 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:04:26.677545 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09841158-1a11-44e8-97bb-b0a69a0e4388 None None] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:04:26.678099 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09841158-1a11-44e8-97bb-b0a69a0e4388 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:04:26.678099 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09841158-1a11-44e8-97bb-b0a69a0e4388 None None] PATH_INFO: `/` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:04:26.679462 dv-cinder-862365-1-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 474/938] 10.222.0.23 () {54 vars in 927 bytes} [Fri Oct 28 19:04:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 19:04:26.685219 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5a8545-9158-491c-a24c-216b2371941c None None] REQUEST_METHOD: `POST` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:04:26.688741 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5a8545-9158-491c-a24c-216b2371941c None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:04:26.688741 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5a8545-9158-491c-a24c-216b2371941c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:04:26.704487 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.auth.core [None req-1c5a8545-9158-491c-a24c-216b2371941c None None] MFA Rules not processed for user `ae863915635746d1ac19970949de4722`. Rule list: `[]` (Enabled: `True`). {{(pid=81765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:04:26.711755 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-1c5a8545-9158-491c-a24c-216b2371941c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:04:26.711755 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:04:26.770071 dv-cinder-862365-1-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 465/939] 10.222.0.23 () {58 vars in 1024 bytes} [Fri Oct 28 19:04:26 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 28 19:04:27.036929 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09841158-1a11-44e8-97bb-b0a69a0e4388 None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:04:27.137683 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09841158-1a11-44e8-97bb-b0a69a0e4388 None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:04:27.165871 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:04:27.172052 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a734fe12-90b0-4f8b-9da5-f756cd79fa71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:04:27.172675 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a734fe12-90b0-4f8b-9da5-f756cd79fa71 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:04:27.172955 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a734fe12-90b0-4f8b-9da5-f756cd79fa71 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:04:27.173228 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a734fe12-90b0-4f8b-9da5-f756cd79fa71 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:04:27.182976 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a734fe12-90b0-4f8b-9da5-f756cd79fa71 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 19:04:27.188762 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application [None req-a734fe12-90b0-4f8b-9da5-f756cd79fa71 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 28 19:04:27.188762 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 19:04:27.188762 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 19:04:27.188762 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 19:04:27.188762 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 19:04:27.188762 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 19:04:27.188762 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 19:04:27.188762 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 19:04:27.188762 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 19:04:27.188762 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 19:04:27.188762 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 19:04:27.188762 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 19:04:27.188762 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 28 19:04:27.188762 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 28 19:04:27.188762 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 28 19:04:27.188762 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 28 19:04:27.190160 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 28 19:04:27.190160 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 28 19:04:27.190160 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 28 19:04:27.190160 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 28 19:04:27.190160 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 19:04:27.190160 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 19:04:27.190160 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 19:04:27.190160 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 19:04:27.190160 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 19:04:27.190160 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 19:04:27.190160 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 19:04:27.190160 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application with Lock( Oct 28 19:04:27.190160 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 19:04:27.190160 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._enter() Oct 28 19:04:27.190160 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 19:04:27.190160 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 19:04:27.191276 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 19:04:27.191276 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.creator() Oct 28 19:04:27.191276 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 19:04:27.191276 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application created_value = creator( Oct 28 19:04:27.191276 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 28 19:04:27.191276 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 28 19:04:27.191276 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 28 19:04:27.191276 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 28 19:04:27.191276 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 28 19:04:27.191276 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 28 19:04:27.191276 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 28 19:04:27.191276 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Oct 28 19:04:27.191276 dv-cinder-862365-1-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 475/940] 10.222.0.23 () {56 vars in 1096 bytes} [Fri Oct 28 19:04:27 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 19:04:27.196219 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5a8545-9158-491c-a24c-216b2371941c None None] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:04:27.293753 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5a8545-9158-491c-a24c-216b2371941c None None] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:04:27.327242 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea0f753-4bfd-42a5-ab2b-182309c00efe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:04:27.327838 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea0f753-4bfd-42a5-ab2b-182309c00efe None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:04:27.328117 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea0f753-4bfd-42a5-ab2b-182309c00efe None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:04:27.328386 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea0f753-4bfd-42a5-ab2b-182309c00efe None admin] PATH_INFO: `/v3/roles` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:04:27.329034 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea0f753-4bfd-42a5-ab2b-182309c00efe None admin] RBAC: Adding query filter params (name=admin) {{(pid=81765) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:04:27.329333 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea0f753-4bfd-42a5-ab2b-182309c00efe None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:04:27.330708 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea0f753-4bfd-42a5-ab2b-182309c00efe None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:04:27.338766 dv-cinder-862365-1-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 466/941] 10.222.0.23 () {56 vars in 1099 bytes} [Fri Oct 28 19:04:27 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 19:04:27.344740 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a734fe12-90b0-4f8b-9da5-f756cd79fa71 None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:04:27.445771 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a734fe12-90b0-4f8b-9da5-f756cd79fa71 None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:04:27.479086 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4631b3c-64ba-4ada-86d3-454169947da6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:04:27.479702 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4631b3c-64ba-4ada-86d3-454169947da6 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:04:27.479981 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4631b3c-64ba-4ada-86d3-454169947da6 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:04:27.480259 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4631b3c-64ba-4ada-86d3-454169947da6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:04:27.491071 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4631b3c-64ba-4ada-86d3-454169947da6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:04:27.492494 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4631b3c-64ba-4ada-86d3-454169947da6 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:04:27.506154 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application [None req-b4631b3c-64ba-4ada-86d3-454169947da6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 19:04:27.506154 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 19:04:27.506154 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 19:04:27.506154 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 19:04:27.506154 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 19:04:27.506154 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 19:04:27.506154 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 19:04:27.506154 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 19:04:27.506154 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 19:04:27.506154 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 19:04:27.506154 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 19:04:27.506154 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 19:04:27.506154 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 28 19:04:27.506154 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 28 19:04:27.506154 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 28 19:04:27.506154 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 28 19:04:27.507300 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 19:04:27.507300 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 19:04:27.507300 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 19:04:27.507300 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 19:04:27.507300 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 19:04:27.507300 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 19:04:27.507300 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 19:04:27.507300 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application with Lock( Oct 28 19:04:27.507300 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 19:04:27.507300 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._enter() Oct 28 19:04:27.507300 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 19:04:27.507300 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 19:04:27.507300 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 19:04:27.507300 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.creator() Oct 28 19:04:27.507300 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 19:04:27.507300 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application created_value = creator( Oct 28 19:04:27.507300 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 28 19:04:27.508365 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 28 19:04:27.508365 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 19:04:27.508365 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Oct 28 19:04:27.508365 dv-cinder-862365-1-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 476/942] 10.222.0.23 () {56 vars in 1108 bytes} [Fri Oct 28 19:04:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 19:04:27.513007 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea0f753-4bfd-42a5-ab2b-182309c00efe None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:04:27.515912 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:04:27.610823 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea0f753-4bfd-42a5-ab2b-182309c00efe None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:04:27.643518 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e0ee6d-f061-48fb-b319-212a6cecb3ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:04:27.644113 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e0ee6d-f061-48fb-b319-212a6cecb3ed None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:04:27.644421 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e0ee6d-f061-48fb-b319-212a6cecb3ed None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:04:27.644702 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e0ee6d-f061-48fb-b319-212a6cecb3ed None admin] PATH_INFO: `/v3/domains` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:04:27.645390 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e0ee6d-f061-48fb-b319-212a6cecb3ed None admin] RBAC: Adding query filter params (name=Default) {{(pid=81765) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:04:27.645694 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e0ee6d-f061-48fb-b319-212a6cecb3ed None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:04:27.647041 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e0ee6d-f061-48fb-b319-212a6cecb3ed None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:04:27.659036 dv-cinder-862365-1-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 467/943] 10.222.0.23 () {56 vars in 1109 bytes} [Fri Oct 28 19:04:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:04:27.664777 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4631b3c-64ba-4ada-86d3-454169947da6 None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:04:27.707343 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:04:27.764092 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4631b3c-64ba-4ada-86d3-454169947da6 None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:04:27.798234 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c8e3fb-f916-4b85-a4e5-321f14aa4a2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:04:27.798854 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c8e3fb-f916-4b85-a4e5-321f14aa4a2c None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:04:27.799131 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c8e3fb-f916-4b85-a4e5-321f14aa4a2c None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:04:27.799400 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c8e3fb-f916-4b85-a4e5-321f14aa4a2c None admin] PATH_INFO: `/v3/users/placement` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:04:27.807320 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c8e3fb-f916-4b85-a4e5-321f14aa4a2c None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:04:27.808744 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c8e3fb-f916-4b85-a4e5-321f14aa4a2c None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:04:27.820026 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application [None req-75c8e3fb-f916-4b85-a4e5-321f14aa4a2c None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Oct 28 19:04:27.820026 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 19:04:27.820026 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 19:04:27.820026 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 19:04:27.820026 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 19:04:27.820026 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 19:04:27.820026 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 19:04:27.820026 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 19:04:27.820026 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 19:04:27.820026 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 19:04:27.820026 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 19:04:27.820026 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 19:04:27.820026 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 28 19:04:27.820026 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 28 19:04:27.820026 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 28 19:04:27.820026 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 28 19:04:27.821040 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 19:04:27.821040 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 19:04:27.821040 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 28 19:04:27.821040 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 28 19:04:27.821040 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 28 19:04:27.821040 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 28 19:04:27.821040 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 19:04:27.821040 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 19:04:27.821040 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 19:04:27.821040 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 19:04:27.821040 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 19:04:27.821040 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application with Lock( Oct 28 19:04:27.821040 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 19:04:27.821040 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._enter() Oct 28 19:04:27.821040 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 19:04:27.821040 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 19:04:27.821040 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 19:04:27.821040 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.creator() Oct 28 19:04:27.822095 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 19:04:27.822095 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application created_value = creator( Oct 28 19:04:27.822095 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 28 19:04:27.822095 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 28 19:04:27.822095 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 28 19:04:27.822095 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 28 19:04:27.822095 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 28 19:04:27.822095 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 28 19:04:27.822095 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Oct 28 19:04:27.822095 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Oct 28 19:04:27.822095 dv-cinder-862365-1-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 477/944] 10.222.0.23 () {56 vars in 1108 bytes} [Fri Oct 28 19:04:27 2022] GET /identity/v3/users/placement => generated 87 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 19:04:27.832367 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e0ee6d-f061-48fb-b319-212a6cecb3ed None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:04:27.896250 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:04:27.933067 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e0ee6d-f061-48fb-b319-212a6cecb3ed None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:04:27.966767 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdedb810-3eb9-4be6-bf78-4a35e921b446 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:04:27.967362 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdedb810-3eb9-4be6-bf78-4a35e921b446 None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:04:27.967642 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdedb810-3eb9-4be6-bf78-4a35e921b446 None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:04:27.967915 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdedb810-3eb9-4be6-bf78-4a35e921b446 None admin] PATH_INFO: `/v3/users` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:04:27.968627 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdedb810-3eb9-4be6-bf78-4a35e921b446 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81765) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:04:27.968930 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdedb810-3eb9-4be6-bf78-4a35e921b446 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:04:27.970363 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdedb810-3eb9-4be6-bf78-4a35e921b446 None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:04:27.987067 dv-cinder-862365-1-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 468/945] 10.222.0.23 () {56 vars in 1143 bytes} [Fri Oct 28 19:04:27 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:04:27.992832 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c8e3fb-f916-4b85-a4e5-321f14aa4a2c None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:04:28.093184 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c8e3fb-f916-4b85-a4e5-321f14aa4a2c None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:04:28.094721 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:04:28.129173 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b0f664-dab3-4728-a9d7-52d82d710c5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:04:28.129949 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b0f664-dab3-4728-a9d7-52d82d710c5a None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:04:28.130235 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b0f664-dab3-4728-a9d7-52d82d710c5a None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:04:28.130519 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b0f664-dab3-4728-a9d7-52d82d710c5a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:04:28.142055 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b0f664-dab3-4728-a9d7-52d82d710c5a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:04:28.143531 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b0f664-dab3-4728-a9d7-52d82d710c5a None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:04:28.157968 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application [None req-06b0f664-dab3-4728-a9d7-52d82d710c5a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 19:04:28.157968 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 19:04:28.157968 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 19:04:28.157968 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 19:04:28.157968 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 19:04:28.157968 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 19:04:28.157968 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 19:04:28.157968 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 19:04:28.157968 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 19:04:28.157968 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 19:04:28.157968 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 19:04:28.157968 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 19:04:28.157968 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 28 19:04:28.157968 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 28 19:04:28.157968 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 28 19:04:28.157968 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 28 19:04:28.158993 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 19:04:28.158993 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 19:04:28.158993 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 19:04:28.158993 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 19:04:28.158993 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 19:04:28.158993 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 19:04:28.158993 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 19:04:28.158993 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application with Lock( Oct 28 19:04:28.158993 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 19:04:28.158993 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._enter() Oct 28 19:04:28.158993 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 19:04:28.158993 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 19:04:28.158993 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 19:04:28.158993 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.creator() Oct 28 19:04:28.158993 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 19:04:28.158993 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application created_value = creator( Oct 28 19:04:28.158993 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 28 19:04:28.160315 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 28 19:04:28.160315 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 19:04:28.160315 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Oct 28 19:04:28.160315 dv-cinder-862365-1-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 478/946] 10.222.0.23 () {56 vars in 1108 bytes} [Fri Oct 28 19:04:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 19:04:28.164899 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdedb810-3eb9-4be6-bf78-4a35e921b446 None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:04:28.268280 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdedb810-3eb9-4be6-bf78-4a35e921b446 None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:04:28.288675 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:04:28.302569 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a9fee1-6932-45ad-8506-be571b9772ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:04:28.303175 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a9fee1-6932-45ad-8506-be571b9772ef None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:04:28.303450 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a9fee1-6932-45ad-8506-be571b9772ef None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:04:28.303720 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a9fee1-6932-45ad-8506-be571b9772ef None admin] PATH_INFO: `/v3/domains` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:04:28.304358 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a9fee1-6932-45ad-8506-be571b9772ef None admin] RBAC: Adding query filter params (name=Default) {{(pid=81765) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:04:28.304656 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a9fee1-6932-45ad-8506-be571b9772ef None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:04:28.306075 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a9fee1-6932-45ad-8506-be571b9772ef None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:04:28.317791 dv-cinder-862365-1-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 469/947] 10.222.0.23 () {56 vars in 1109 bytes} [Fri Oct 28 19:04:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 19:04:28.323688 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b0f664-dab3-4728-a9d7-52d82d710c5a None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:04:28.429801 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b0f664-dab3-4728-a9d7-52d82d710c5a None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:04:28.462893 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e99d221-37f0-4cbe-91dd-464a4948d22d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:04:28.463761 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e99d221-37f0-4cbe-91dd-464a4948d22d None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:04:28.464064 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e99d221-37f0-4cbe-91dd-464a4948d22d None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:04:28.464373 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e99d221-37f0-4cbe-91dd-464a4948d22d None admin] PATH_INFO: `/v3/projects/service` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:04:28.470832 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e99d221-37f0-4cbe-91dd-464a4948d22d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:04:28.473196 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e99d221-37f0-4cbe-91dd-464a4948d22d None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:04:28.484631 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application [None req-1e99d221-37f0-4cbe-91dd-464a4948d22d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 28 19:04:28.484631 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 19:04:28.484631 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 19:04:28.484631 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 19:04:28.484631 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 19:04:28.484631 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 19:04:28.484631 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 19:04:28.484631 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 19:04:28.484631 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 19:04:28.484631 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 19:04:28.484631 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 19:04:28.484631 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 19:04:28.484631 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 28 19:04:28.484631 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 28 19:04:28.484631 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 28 19:04:28.485704 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 28 19:04:28.485704 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 19:04:28.485704 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 19:04:28.485704 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 19:04:28.485704 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 19:04:28.485704 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 19:04:28.485704 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 19:04:28.485704 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 19:04:28.485704 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application with Lock( Oct 28 19:04:28.485704 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 19:04:28.485704 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._enter() Oct 28 19:04:28.485704 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 19:04:28.485704 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 19:04:28.485704 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 19:04:28.485704 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.creator() Oct 28 19:04:28.485704 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 19:04:28.485704 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application created_value = creator( Oct 28 19:04:28.486653 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 28 19:04:28.486653 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 28 19:04:28.486653 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 28 19:04:28.486653 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 28 19:04:28.486653 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 28 19:04:28.486653 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 28 19:04:28.486653 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 28 19:04:28.486653 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Oct 28 19:04:28.486653 dv-cinder-862365-1-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 479/948] 10.222.0.23 () {56 vars in 1111 bytes} [Fri Oct 28 19:04:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 19:04:28.491928 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a9fee1-6932-45ad-8506-be571b9772ef None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:04:28.591129 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a9fee1-6932-45ad-8506-be571b9772ef None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:04:28.624239 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ba2b6a-1a0c-4e60-818d-233234214f3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:04:28.624837 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ba2b6a-1a0c-4e60-818d-233234214f3d None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:04:28.625120 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ba2b6a-1a0c-4e60-818d-233234214f3d None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:04:28.625415 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ba2b6a-1a0c-4e60-818d-233234214f3d None admin] PATH_INFO: `/v3/projects` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:04:28.626095 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ba2b6a-1a0c-4e60-818d-233234214f3d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81765) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:04:28.626401 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ba2b6a-1a0c-4e60-818d-233234214f3d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:04:28.627857 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ba2b6a-1a0c-4e60-818d-233234214f3d None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:04:28.640087 dv-cinder-862365-1-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 470/949] 10.222.0.23 () {56 vars in 1148 bytes} [Fri Oct 28 19:04:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:04:28.646457 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e99d221-37f0-4cbe-91dd-464a4948d22d None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:04:28.662604 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:04:28.744370 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e99d221-37f0-4cbe-91dd-464a4948d22d None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:04:28.777076 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e4444b-8af1-4364-a85f-fff699bb71f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:04:28.782185 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e4444b-8af1-4364-a85f-fff699bb71f0 None admin] REQUEST_METHOD: `PUT` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:04:28.782185 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e4444b-8af1-4364-a85f-fff699bb71f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:04:28.782185 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e4444b-8af1-4364-a85f-fff699bb71f0 None admin] PATH_INFO: `/v3/projects/b705897907f042c0818a931052438e1e/users/c3308c9156d44c5599514ffaf708d4b3/roles/a9e4e47c2bf448fcbada91c1174644f7` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:04:28.782185 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e4444b-8af1-4364-a85f-fff699bb71f0 None admin] RBAC: Authorizing `identity:create_grant(project_id=b705897907f042c0818a931052438e1e, user_id=c3308c9156d44c5599514ffaf708d4b3, role_id=a9e4e47c2bf448fcbada91c1174644f7)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:04:28.782185 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e4444b-8af1-4364-a85f-fff699bb71f0 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:04:28.923417 dv-cinder-862365-1-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 480/950] 10.222.0.23 () {58 vars in 1439 bytes} [Fri Oct 28 19:04:28 2022] PUT /identity/v3/projects/b705897907f042c0818a931052438e1e/users/c3308c9156d44c5599514ffaf708d4b3/roles/a9e4e47c2bf448fcbada91c1174644f7 => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 19:04:31.101880 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edaf122-465b-4322-bd76-bcbbbc8e78f8 None None] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:04:31.102385 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edaf122-465b-4322-bd76-bcbbbc8e78f8 None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:04:31.102385 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edaf122-465b-4322-bd76-bcbbbc8e78f8 None None] PATH_INFO: `/` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:04:31.103830 dv-cinder-862365-1-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 471/951] 10.222.0.23 () {54 vars in 927 bytes} [Fri Oct 28 19:04:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 19:04:31.109310 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc6d102-3302-4d67-b055-800e9ab97ade None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:04:31.109727 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc6d102-3302-4d67-b055-800e9ab97ade None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:04:31.109940 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc6d102-3302-4d67-b055-800e9ab97ade None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:04:31.128283 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-4bc6d102-3302-4d67-b055-800e9ab97ade None None] MFA Rules not processed for user `ae863915635746d1ac19970949de4722`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:04:31.129488 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-4bc6d102-3302-4d67-b055-800e9ab97ade None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:04:31.194543 dv-cinder-862365-1-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 481/952] 10.222.0.23 () {58 vars in 1024 bytes} [Fri Oct 28 19:04:31 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 28 19:04:31.468575 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6edaf122-465b-4322-bd76-bcbbbc8e78f8 None None] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:04:31.512708 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:04:31.568527 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6edaf122-465b-4322-bd76-bcbbbc8e78f8 None None] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:04:31.602476 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d410f47-da0c-44a2-b969-921013b84a37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:04:31.603086 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d410f47-da0c-44a2-b969-921013b84a37 None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:04:31.603370 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d410f47-da0c-44a2-b969-921013b84a37 None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:04:31.603648 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d410f47-da0c-44a2-b969-921013b84a37 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:04:31.614416 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d410f47-da0c-44a2-b969-921013b84a37 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 19:04:31.619261 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application [None req-1d410f47-da0c-44a2-b969-921013b84a37 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 28 19:04:31.619261 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 19:04:31.619261 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 19:04:31.619261 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 19:04:31.619261 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 19:04:31.619261 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 19:04:31.619261 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 19:04:31.619261 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 19:04:31.619261 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 19:04:31.619261 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 19:04:31.619261 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 19:04:31.619261 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 19:04:31.619261 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 28 19:04:31.619261 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 28 19:04:31.619261 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 28 19:04:31.619261 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 28 19:04:31.620903 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 28 19:04:31.620903 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 28 19:04:31.620903 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 28 19:04:31.620903 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 28 19:04:31.620903 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 19:04:31.620903 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 19:04:31.620903 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 19:04:31.620903 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 19:04:31.620903 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 19:04:31.620903 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 19:04:31.620903 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 19:04:31.620903 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application with Lock( Oct 28 19:04:31.620903 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 19:04:31.620903 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._enter() Oct 28 19:04:31.620903 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 19:04:31.620903 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 19:04:31.623325 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 19:04:31.623325 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.creator() Oct 28 19:04:31.623325 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 19:04:31.623325 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application created_value = creator( Oct 28 19:04:31.623325 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 28 19:04:31.623325 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 28 19:04:31.623325 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 28 19:04:31.623325 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 28 19:04:31.623325 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 28 19:04:31.623325 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 28 19:04:31.623325 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 28 19:04:31.623325 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application Oct 28 19:04:31.623325 dv-cinder-862365-1-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 472/953] 10.222.0.23 () {56 vars in 1096 bytes} [Fri Oct 28 19:04:31 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 28 19:04:31.627038 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc6d102-3302-4d67-b055-800e9ab97ade None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:04:31.630189 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:04:31.726765 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc6d102-3302-4d67-b055-800e9ab97ade None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:04:31.760977 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dae5c6c-f12f-4ab9-b2a1-64e25068d10c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:04:31.761604 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dae5c6c-f12f-4ab9-b2a1-64e25068d10c None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:04:31.761897 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dae5c6c-f12f-4ab9-b2a1-64e25068d10c None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:04:31.762170 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dae5c6c-f12f-4ab9-b2a1-64e25068d10c None admin] PATH_INFO: `/v3/roles` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:04:31.762820 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dae5c6c-f12f-4ab9-b2a1-64e25068d10c None admin] RBAC: Adding query filter params (name=admin) {{(pid=81766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:04:31.763113 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dae5c6c-f12f-4ab9-b2a1-64e25068d10c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:04:31.764461 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dae5c6c-f12f-4ab9-b2a1-64e25068d10c None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:04:31.772016 dv-cinder-862365-1-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 482/954] 10.222.0.23 () {56 vars in 1099 bytes} [Fri Oct 28 19:04:31 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:04:31.779398 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d410f47-da0c-44a2-b969-921013b84a37 None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:04:31.883607 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:04:31.886741 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d410f47-da0c-44a2-b969-921013b84a37 None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:04:31.922207 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd5b3e1-9426-4464-82e7-3d298ff8c527 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:04:31.922836 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd5b3e1-9426-4464-82e7-3d298ff8c527 None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:04:31.923116 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd5b3e1-9426-4464-82e7-3d298ff8c527 None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:04:31.923390 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd5b3e1-9426-4464-82e7-3d298ff8c527 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:04:31.933701 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd5b3e1-9426-4464-82e7-3d298ff8c527 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:04:31.935137 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd5b3e1-9426-4464-82e7-3d298ff8c527 None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:04:31.948851 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application [None req-8cd5b3e1-9426-4464-82e7-3d298ff8c527 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 19:04:31.948851 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 19:04:31.948851 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 19:04:31.948851 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 19:04:31.948851 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 19:04:31.948851 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 19:04:31.948851 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 19:04:31.948851 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 19:04:31.948851 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 19:04:31.948851 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 19:04:31.948851 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 19:04:31.948851 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 19:04:31.948851 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 28 19:04:31.948851 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 28 19:04:31.948851 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 28 19:04:31.948851 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 28 19:04:31.949951 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 19:04:31.949951 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 19:04:31.949951 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 19:04:31.949951 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 19:04:31.949951 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 19:04:31.949951 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 19:04:31.949951 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 19:04:31.949951 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application with Lock( Oct 28 19:04:31.949951 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 19:04:31.949951 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._enter() Oct 28 19:04:31.949951 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 19:04:31.949951 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 19:04:31.949951 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 19:04:31.949951 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.creator() Oct 28 19:04:31.949951 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 19:04:31.949951 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application created_value = creator( Oct 28 19:04:31.949951 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 28 19:04:31.950862 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 28 19:04:31.950862 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 19:04:31.950862 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application Oct 28 19:04:31.950862 dv-cinder-862365-1-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 473/955] 10.222.0.23 () {56 vars in 1108 bytes} [Fri Oct 28 19:04:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 19:04:31.956167 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dae5c6c-f12f-4ab9-b2a1-64e25068d10c None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:04:32.019938 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:04:32.052896 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dae5c6c-f12f-4ab9-b2a1-64e25068d10c None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:04:32.083996 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6509b96b-5761-48a0-be2c-e415933bd3a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:04:32.084590 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6509b96b-5761-48a0-be2c-e415933bd3a2 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:04:32.084870 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6509b96b-5761-48a0-be2c-e415933bd3a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:04:32.085144 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6509b96b-5761-48a0-be2c-e415933bd3a2 None admin] PATH_INFO: `/v3/domains` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:04:32.085799 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6509b96b-5761-48a0-be2c-e415933bd3a2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:04:32.086102 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6509b96b-5761-48a0-be2c-e415933bd3a2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:04:32.087457 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6509b96b-5761-48a0-be2c-e415933bd3a2 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:04:32.099283 dv-cinder-862365-1-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 483/956] 10.222.0.23 () {56 vars in 1109 bytes} [Fri Oct 28 19:04:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:04:32.104981 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd5b3e1-9426-4464-82e7-3d298ff8c527 None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:04:32.205085 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd5b3e1-9426-4464-82e7-3d298ff8c527 None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:04:32.239306 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f53bf4-9f1f-4ef2-a12b-a3575bcf224a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:04:32.239923 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f53bf4-9f1f-4ef2-a12b-a3575bcf224a None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:04:32.240203 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f53bf4-9f1f-4ef2-a12b-a3575bcf224a None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:04:32.240475 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f53bf4-9f1f-4ef2-a12b-a3575bcf224a None admin] PATH_INFO: `/v3/users/placement` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:04:32.247942 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f53bf4-9f1f-4ef2-a12b-a3575bcf224a None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:04:32.249388 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f53bf4-9f1f-4ef2-a12b-a3575bcf224a None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:04:32.260532 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application [None req-d7f53bf4-9f1f-4ef2-a12b-a3575bcf224a None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Oct 28 19:04:32.260532 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 19:04:32.260532 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 19:04:32.260532 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 19:04:32.260532 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 19:04:32.260532 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 19:04:32.260532 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 19:04:32.260532 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 19:04:32.260532 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 19:04:32.260532 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 19:04:32.260532 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 19:04:32.260532 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 19:04:32.260532 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 28 19:04:32.260532 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 28 19:04:32.260532 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 28 19:04:32.260532 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 28 19:04:32.261655 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 19:04:32.261655 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 19:04:32.261655 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 28 19:04:32.261655 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 28 19:04:32.261655 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 28 19:04:32.261655 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 28 19:04:32.261655 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 19:04:32.261655 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 19:04:32.261655 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 19:04:32.261655 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 19:04:32.261655 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 19:04:32.261655 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application with Lock( Oct 28 19:04:32.261655 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 19:04:32.261655 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._enter() Oct 28 19:04:32.261655 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 19:04:32.261655 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 19:04:32.261655 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 19:04:32.261655 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.creator() Oct 28 19:04:32.263155 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 19:04:32.263155 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application created_value = creator( Oct 28 19:04:32.263155 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 28 19:04:32.263155 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 28 19:04:32.263155 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 28 19:04:32.263155 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 28 19:04:32.263155 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 28 19:04:32.263155 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 28 19:04:32.263155 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Oct 28 19:04:32.263155 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application Oct 28 19:04:32.263155 dv-cinder-862365-1-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 474/957] 10.222.0.23 () {56 vars in 1108 bytes} [Fri Oct 28 19:04:32 2022] GET /identity/v3/users/placement => generated 87 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 19:04:32.268206 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6509b96b-5761-48a0-be2c-e415933bd3a2 None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:04:32.365907 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6509b96b-5761-48a0-be2c-e415933bd3a2 None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:04:32.390319 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:04:32.398871 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74d8729-950c-4944-880f-8cccd1d1f5cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:04:32.399598 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74d8729-950c-4944-880f-8cccd1d1f5cb None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:04:32.399874 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74d8729-950c-4944-880f-8cccd1d1f5cb None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:04:32.400158 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74d8729-950c-4944-880f-8cccd1d1f5cb None admin] PATH_INFO: `/v3/users` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:04:32.401145 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74d8729-950c-4944-880f-8cccd1d1f5cb None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:04:32.401865 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74d8729-950c-4944-880f-8cccd1d1f5cb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:04:32.403293 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74d8729-950c-4944-880f-8cccd1d1f5cb None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:04:32.421088 dv-cinder-862365-1-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 484/958] 10.222.0.23 () {56 vars in 1143 bytes} [Fri Oct 28 19:04:32 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:04:32.426917 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f53bf4-9f1f-4ef2-a12b-a3575bcf224a None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:04:32.441924 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:04:32.522216 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f53bf4-9f1f-4ef2-a12b-a3575bcf224a None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:04:32.556120 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9addc4ac-b5cd-4068-b418-77ee171e87f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:04:32.556713 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9addc4ac-b5cd-4068-b418-77ee171e87f2 None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:04:32.557012 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9addc4ac-b5cd-4068-b418-77ee171e87f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:04:32.557266 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9addc4ac-b5cd-4068-b418-77ee171e87f2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:04:32.622448 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9addc4ac-b5cd-4068-b418-77ee171e87f2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:04:32.623816 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9addc4ac-b5cd-4068-b418-77ee171e87f2 None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:04:32.637445 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:04:32.719810 dv-cinder-862365-1-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 475/959] 10.222.0.23 () {58 vars in 1282 bytes} [Fri Oct 28 19:04:32 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 28 19:04:32.725781 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74d8729-950c-4944-880f-8cccd1d1f5cb None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:04:32.823496 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74d8729-950c-4944-880f-8cccd1d1f5cb None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:04:32.857561 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554e46f4-0e08-46aa-ada9-7f86ed87a096 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:04:32.858200 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554e46f4-0e08-46aa-ada9-7f86ed87a096 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:04:32.858469 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554e46f4-0e08-46aa-ada9-7f86ed87a096 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:04:32.858738 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554e46f4-0e08-46aa-ada9-7f86ed87a096 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:04:32.869016 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554e46f4-0e08-46aa-ada9-7f86ed87a096 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:04:32.870467 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554e46f4-0e08-46aa-ada9-7f86ed87a096 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:04:32.884393 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application [None req-554e46f4-0e08-46aa-ada9-7f86ed87a096 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 19:04:32.884393 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 19:04:32.884393 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 19:04:32.884393 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 19:04:32.884393 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 19:04:32.884393 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 19:04:32.884393 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 19:04:32.884393 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 19:04:32.884393 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 19:04:32.884393 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 19:04:32.884393 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 19:04:32.884393 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 19:04:32.884393 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 28 19:04:32.884393 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 28 19:04:32.884393 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 28 19:04:32.884393 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 28 19:04:32.885557 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 19:04:32.885557 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 19:04:32.885557 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 19:04:32.885557 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 19:04:32.885557 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 19:04:32.885557 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 19:04:32.885557 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 19:04:32.885557 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application with Lock( Oct 28 19:04:32.885557 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 19:04:32.885557 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._enter() Oct 28 19:04:32.885557 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 19:04:32.885557 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 19:04:32.885557 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 19:04:32.885557 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.creator() Oct 28 19:04:32.885557 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 19:04:32.885557 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application created_value = creator( Oct 28 19:04:32.885557 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 28 19:04:32.886780 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 28 19:04:32.886780 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 19:04:32.886780 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Oct 28 19:04:32.886780 dv-cinder-862365-1-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 485/960] 10.222.0.23 () {56 vars in 1108 bytes} [Fri Oct 28 19:04:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 19:04:32.891480 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9addc4ac-b5cd-4068-b418-77ee171e87f2 None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:04:32.990854 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9addc4ac-b5cd-4068-b418-77ee171e87f2 None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:04:33.003641 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:04:33.024143 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0b8e8e-451a-4189-a879-5c41368fc074 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:04:33.024864 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0b8e8e-451a-4189-a879-5c41368fc074 None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:04:33.025137 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0b8e8e-451a-4189-a879-5c41368fc074 None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:04:33.027308 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0b8e8e-451a-4189-a879-5c41368fc074 None admin] PATH_INFO: `/v3/domains` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:04:33.027308 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0b8e8e-451a-4189-a879-5c41368fc074 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81765) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:04:33.027308 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0b8e8e-451a-4189-a879-5c41368fc074 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:04:33.028269 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0b8e8e-451a-4189-a879-5c41368fc074 None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:04:33.039093 dv-cinder-862365-1-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 476/961] 10.222.0.23 () {56 vars in 1109 bytes} [Fri Oct 28 19:04:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:04:33.044855 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554e46f4-0e08-46aa-ada9-7f86ed87a096 None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:04:33.079159 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:04:33.140895 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554e46f4-0e08-46aa-ada9-7f86ed87a096 None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:04:33.172799 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5ccb08-dee6-4751-b103-aa835f439107 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:04:33.173440 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5ccb08-dee6-4751-b103-aa835f439107 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:04:33.173723 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5ccb08-dee6-4751-b103-aa835f439107 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:04:33.173996 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5ccb08-dee6-4751-b103-aa835f439107 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:04:33.180494 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5ccb08-dee6-4751-b103-aa835f439107 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:04:33.182078 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5ccb08-dee6-4751-b103-aa835f439107 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:04:33.193769 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application [None req-0f5ccb08-dee6-4751-b103-aa835f439107 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 28 19:04:33.193769 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 19:04:33.193769 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 19:04:33.193769 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 19:04:33.193769 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 19:04:33.193769 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 19:04:33.193769 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 19:04:33.193769 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 19:04:33.193769 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 19:04:33.193769 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 19:04:33.193769 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 19:04:33.193769 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 19:04:33.193769 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 28 19:04:33.193769 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 28 19:04:33.193769 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 28 19:04:33.194838 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 28 19:04:33.194838 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 19:04:33.194838 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 19:04:33.194838 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 19:04:33.194838 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 19:04:33.194838 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 19:04:33.194838 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 19:04:33.194838 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 19:04:33.194838 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application with Lock( Oct 28 19:04:33.194838 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 19:04:33.194838 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._enter() Oct 28 19:04:33.194838 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 19:04:33.194838 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 19:04:33.194838 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 19:04:33.194838 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.creator() Oct 28 19:04:33.194838 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 19:04:33.194838 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application created_value = creator( Oct 28 19:04:33.195975 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 28 19:04:33.195975 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 28 19:04:33.195975 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 28 19:04:33.195975 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 28 19:04:33.195975 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 28 19:04:33.195975 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 28 19:04:33.195975 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 28 19:04:33.195975 dv-cinder-862365-1-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Oct 28 19:04:33.195975 dv-cinder-862365-1-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 486/962] 10.222.0.23 () {56 vars in 1111 bytes} [Fri Oct 28 19:04:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 19:04:33.201203 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0b8e8e-451a-4189-a879-5c41368fc074 None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:04:33.300812 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0b8e8e-451a-4189-a879-5c41368fc074 None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:04:33.333832 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae27cc3-4ee4-486a-8c64-6cfb50335410 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:04:33.334432 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae27cc3-4ee4-486a-8c64-6cfb50335410 None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:04:33.334714 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae27cc3-4ee4-486a-8c64-6cfb50335410 None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:04:33.334990 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae27cc3-4ee4-486a-8c64-6cfb50335410 None admin] PATH_INFO: `/v3/projects` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:04:33.335673 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae27cc3-4ee4-486a-8c64-6cfb50335410 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81765) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:04:33.335981 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae27cc3-4ee4-486a-8c64-6cfb50335410 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:04:33.337429 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae27cc3-4ee4-486a-8c64-6cfb50335410 None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:04:33.349858 dv-cinder-862365-1-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 477/963] 10.222.0.23 () {56 vars in 1148 bytes} [Fri Oct 28 19:04:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:04:33.356171 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5ccb08-dee6-4751-b103-aa835f439107 None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:04:33.451558 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:04:33.457256 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5ccb08-dee6-4751-b103-aa835f439107 None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:04:33.489750 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6faa8f-ba41-45b8-8517-9586a74e0c36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:04:33.490350 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6faa8f-ba41-45b8-8517-9586a74e0c36 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:04:33.490628 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6faa8f-ba41-45b8-8517-9586a74e0c36 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:04:33.490901 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6faa8f-ba41-45b8-8517-9586a74e0c36 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:04:33.491614 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6faa8f-ba41-45b8-8517-9586a74e0c36 None admin] RBAC: Adding query filter params (role.id=a9e4e47c2bf448fcbada91c1174644f7, scope.project.id=b705897907f042c0818a931052438e1e, user.id=c3308c9156d44c5599514ffaf708d4b3) {{(pid=81766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:04:33.491920 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6faa8f-ba41-45b8-8517-9586a74e0c36 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:04:33.493374 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6faa8f-ba41-45b8-8517-9586a74e0c36 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:04:33.499589 dv-cinder-862365-1-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 487/964] 10.222.0.23 () {56 vars in 1374 bytes} [Fri Oct 28 19:04:33 2022] GET /identity/v3/role_assignments?user.id=c3308c9156d44c5599514ffaf708d4b3&scope.project.id=b705897907f042c0818a931052438e1e&role.id=a9e4e47c2bf448fcbada91c1174644f7 => generated 608 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:04:35.630749 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce22c2a9-21e7-45b4-91f4-23a369beba46 None None] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:04:35.631304 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce22c2a9-21e7-45b4-91f4-23a369beba46 None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:04:35.631304 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce22c2a9-21e7-45b4-91f4-23a369beba46 None None] PATH_INFO: `/` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:04:35.632642 dv-cinder-862365-1-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 478/965] 10.222.0.23 () {54 vars in 927 bytes} [Fri Oct 28 19:04:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 19:04:35.637784 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b53497-b294-4853-8915-7bf61b913abe None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:04:35.638185 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b53497-b294-4853-8915-7bf61b913abe None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:04:35.638333 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b53497-b294-4853-8915-7bf61b913abe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:04:35.656584 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-99b53497-b294-4853-8915-7bf61b913abe None None] MFA Rules not processed for user `ae863915635746d1ac19970949de4722`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:04:35.657780 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-99b53497-b294-4853-8915-7bf61b913abe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:04:35.725937 dv-cinder-862365-1-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 488/966] 10.222.0.23 () {58 vars in 1024 bytes} [Fri Oct 28 19:04:35 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 28 19:04:35.995642 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce22c2a9-21e7-45b4-91f4-23a369beba46 None None] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:04:36.026449 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:04:36.095695 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce22c2a9-21e7-45b4-91f4-23a369beba46 None None] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:04:36.129180 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7258f970-9e8a-475d-a4bb-a6759e914b84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:04:36.129827 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7258f970-9e8a-475d-a4bb-a6759e914b84 None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:04:36.130106 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7258f970-9e8a-475d-a4bb-a6759e914b84 None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:04:36.130378 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7258f970-9e8a-475d-a4bb-a6759e914b84 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:04:36.130952 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7258f970-9e8a-475d-a4bb-a6759e914b84 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:04:36.132352 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7258f970-9e8a-475d-a4bb-a6759e914b84 None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:04:36.141569 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application [None req-7258f970-9e8a-475d-a4bb-a6759e914b84 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Oct 28 19:04:36.141569 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 19:04:36.141569 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 28 19:04:36.141569 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 28 19:04:36.141569 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 28 19:04:36.141569 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 28 19:04:36.141569 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 28 19:04:36.141569 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 28 19:04:36.141569 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Oct 28 19:04:36.141569 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application Oct 28 19:04:36.141569 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 28 19:04:36.141569 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application Oct 28 19:04:36.141569 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 19:04:36.141569 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 19:04:36.141569 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 19:04:36.141569 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 19:04:36.141569 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 19:04:36.142751 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 19:04:36.142751 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 19:04:36.142751 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 19:04:36.142751 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 19:04:36.142751 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 19:04:36.142751 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 19:04:36.142751 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 28 19:04:36.142751 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 28 19:04:36.142751 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 28 19:04:36.142751 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 28 19:04:36.142751 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 19:04:36.142751 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 19:04:36.142751 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 19:04:36.142751 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 19:04:36.142751 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 19:04:36.142751 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 19:04:36.143731 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 19:04:36.143731 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application with Lock( Oct 28 19:04:36.143731 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 19:04:36.143731 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._enter() Oct 28 19:04:36.143731 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 19:04:36.143731 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 19:04:36.143731 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 19:04:36.143731 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.creator() Oct 28 19:04:36.143731 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 19:04:36.143731 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application created_value = creator( Oct 28 19:04:36.143731 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 28 19:04:36.143731 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 28 19:04:36.143731 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Oct 28 19:04:36.143731 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application Oct 28 19:04:36.143731 dv-cinder-862365-1-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 479/967] 10.222.0.23 () {56 vars in 1117 bytes} [Fri Oct 28 19:04:35 2022] GET /identity/v3/services/placement => generated 90 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 19:04:36.148772 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b53497-b294-4853-8915-7bf61b913abe None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:04:36.237833 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:04:36.247450 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b53497-b294-4853-8915-7bf61b913abe None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:04:36.282333 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3c4774-8ada-4531-acb7-ef659134df31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:04:36.282937 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3c4774-8ada-4531-acb7-ef659134df31 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:04:36.283215 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3c4774-8ada-4531-acb7-ef659134df31 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:04:36.283483 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3c4774-8ada-4531-acb7-ef659134df31 None admin] PATH_INFO: `/v3/services` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:04:36.284201 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3c4774-8ada-4531-acb7-ef659134df31 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:04:36.284510 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3c4774-8ada-4531-acb7-ef659134df31 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:04:36.285900 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3c4774-8ada-4531-acb7-ef659134df31 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:04:36.290583 dv-cinder-862365-1-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 489/968] 10.222.0.23 () {56 vars in 1116 bytes} [Fri Oct 28 19:04:36 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:04:36.296415 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7258f970-9e8a-475d-a4bb-a6759e914b84 None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:04:36.390483 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:04:36.396052 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7258f970-9e8a-475d-a4bb-a6759e914b84 None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:04:36.429664 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149e94bc-5c95-440e-87a5-a5590ca3ed6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:04:36.430270 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149e94bc-5c95-440e-87a5-a5590ca3ed6d None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:04:36.430551 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149e94bc-5c95-440e-87a5-a5590ca3ed6d None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:04:36.430826 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149e94bc-5c95-440e-87a5-a5590ca3ed6d None admin] PATH_INFO: `/v3/services` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:04:36.431489 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149e94bc-5c95-440e-87a5-a5590ca3ed6d None admin] RBAC: Adding query filter params (type=placement) {{(pid=81765) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:04:36.431757 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149e94bc-5c95-440e-87a5-a5590ca3ed6d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:04:36.433295 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149e94bc-5c95-440e-87a5-a5590ca3ed6d None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:04:36.438205 dv-cinder-862365-1-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 480/969] 10.222.0.23 () {56 vars in 1116 bytes} [Fri Oct 28 19:04:36 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:04:38.569809 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4122775d-986d-4049-ad32-a49815f9b00a None None] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:04:38.570350 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4122775d-986d-4049-ad32-a49815f9b00a None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:04:38.570350 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4122775d-986d-4049-ad32-a49815f9b00a None None] PATH_INFO: `/` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:04:38.571661 dv-cinder-862365-1-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 490/970] 10.222.0.23 () {54 vars in 927 bytes} [Fri Oct 28 19:04:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 19:04:38.577008 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14dbb39-99e3-4080-b215-562129a420f2 None None] REQUEST_METHOD: `POST` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:04:38.577476 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14dbb39-99e3-4080-b215-562129a420f2 None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:04:38.577616 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14dbb39-99e3-4080-b215-562129a420f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:04:38.596024 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.auth.core [None req-a14dbb39-99e3-4080-b215-562129a420f2 None None] MFA Rules not processed for user `ae863915635746d1ac19970949de4722`. Rule list: `[]` (Enabled: `True`). {{(pid=81765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:04:38.597215 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-a14dbb39-99e3-4080-b215-562129a420f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:04:38.663489 dv-cinder-862365-1-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 481/971] 10.222.0.23 () {58 vars in 1024 bytes} [Fri Oct 28 19:04:38 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 28 19:04:38.931772 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4122775d-986d-4049-ad32-a49815f9b00a None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:04:39.030714 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4122775d-986d-4049-ad32-a49815f9b00a None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:04:39.063026 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a15731-5748-49b3-bbca-1eed6fae6989 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:04:39.063663 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a15731-5748-49b3-bbca-1eed6fae6989 None admin] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:04:39.063948 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a15731-5748-49b3-bbca-1eed6fae6989 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:04:39.064220 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a15731-5748-49b3-bbca-1eed6fae6989 None admin] PATH_INFO: `/v3/services` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:04:39.064859 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a15731-5748-49b3-bbca-1eed6fae6989 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:04:39.066241 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a15731-5748-49b3-bbca-1eed6fae6989 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:04:39.181489 dv-cinder-862365-1-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 491/972] 10.222.0.23 () {60 vars in 1141 bytes} [Fri Oct 28 19:04:38 2022] POST /identity/v3/services => generated 246 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 19:04:41.351636 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88675766-06a1-4a93-8bc4-f7805e18c165 None None] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:04:41.352201 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88675766-06a1-4a93-8bc4-f7805e18c165 None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:04:41.352201 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88675766-06a1-4a93-8bc4-f7805e18c165 None None] PATH_INFO: `/` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:04:41.353567 dv-cinder-862365-1-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 482/973] 10.222.0.23 () {54 vars in 927 bytes} [Fri Oct 28 19:04:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 19:04:41.359339 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82e7a7b-b464-4a52-b6bf-d8ab36e1cf8c None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:04:41.359726 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82e7a7b-b464-4a52-b6bf-d8ab36e1cf8c None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:04:41.359881 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82e7a7b-b464-4a52-b6bf-d8ab36e1cf8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:04:41.378199 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-c82e7a7b-b464-4a52-b6bf-d8ab36e1cf8c None None] MFA Rules not processed for user `ae863915635746d1ac19970949de4722`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:04:41.379360 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-c82e7a7b-b464-4a52-b6bf-d8ab36e1cf8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:04:41.388396 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:04:41.450735 dv-cinder-862365-1-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 492/974] 10.222.0.23 () {58 vars in 1024 bytes} [Fri Oct 28 19:04:41 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 28 19:04:41.721099 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88675766-06a1-4a93-8bc4-f7805e18c165 None None] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:04:41.811082 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:04:41.821691 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88675766-06a1-4a93-8bc4-f7805e18c165 None None] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:04:41.855456 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e3d220-55e7-49aa-a464-47dfd71ae1ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:04:41.858535 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e3d220-55e7-49aa-a464-47dfd71ae1ca None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:04:41.858811 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e3d220-55e7-49aa-a464-47dfd71ae1ca None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:04:41.859082 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e3d220-55e7-49aa-a464-47dfd71ae1ca None admin] PATH_INFO: `/v3/services/placement` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:04:41.859663 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e3d220-55e7-49aa-a464-47dfd71ae1ca None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:04:41.861021 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e3d220-55e7-49aa-a464-47dfd71ae1ca None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:04:41.869780 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application [None req-34e3d220-55e7-49aa-a464-47dfd71ae1ca None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Oct 28 19:04:41.869780 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 19:04:41.869780 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 28 19:04:41.869780 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 28 19:04:41.869780 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 28 19:04:41.869780 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 28 19:04:41.869780 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 28 19:04:41.869780 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 28 19:04:41.869780 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Oct 28 19:04:41.869780 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application Oct 28 19:04:41.869780 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 28 19:04:41.869780 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application Oct 28 19:04:41.869780 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 19:04:41.869780 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 19:04:41.869780 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 19:04:41.869780 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 19:04:41.869780 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 19:04:41.870915 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 19:04:41.870915 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 19:04:41.870915 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 19:04:41.870915 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 19:04:41.870915 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 19:04:41.870915 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 19:04:41.870915 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 28 19:04:41.870915 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 28 19:04:41.870915 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 28 19:04:41.870915 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 28 19:04:41.870915 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 19:04:41.870915 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 19:04:41.870915 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 19:04:41.870915 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 19:04:41.870915 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 19:04:41.870915 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 19:04:41.871930 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 19:04:41.871930 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application with Lock( Oct 28 19:04:41.871930 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 19:04:41.871930 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._enter() Oct 28 19:04:41.871930 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 19:04:41.871930 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 19:04:41.871930 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 19:04:41.871930 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.creator() Oct 28 19:04:41.871930 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 19:04:41.871930 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application created_value = creator( Oct 28 19:04:41.871930 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 28 19:04:41.871930 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 28 19:04:41.871930 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Oct 28 19:04:41.871930 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application Oct 28 19:04:41.871930 dv-cinder-862365-1-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 483/975] 10.222.0.23 () {56 vars in 1117 bytes} [Fri Oct 28 19:04:41 2022] GET /identity/v3/services/placement => generated 90 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 19:04:41.877056 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82e7a7b-b464-4a52-b6bf-d8ab36e1cf8c None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:04:41.984891 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82e7a7b-b464-4a52-b6bf-d8ab36e1cf8c None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:04:42.020714 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3f5d37-03ec-4f58-a64d-531d769b6e5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:04:42.021314 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3f5d37-03ec-4f58-a64d-531d769b6e5d None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:04:42.021631 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3f5d37-03ec-4f58-a64d-531d769b6e5d None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:04:42.021908 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3f5d37-03ec-4f58-a64d-531d769b6e5d None admin] PATH_INFO: `/v3/services` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:04:42.022529 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3f5d37-03ec-4f58-a64d-531d769b6e5d None admin] RBAC: Adding query filter params (name=placement) {{(pid=81766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:04:42.022836 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3f5d37-03ec-4f58-a64d-531d769b6e5d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:04:42.024186 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3f5d37-03ec-4f58-a64d-531d769b6e5d None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:04:42.029788 dv-cinder-862365-1-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 493/976] 10.222.0.23 () {56 vars in 1116 bytes} [Fri Oct 28 19:04:41 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:04:42.035825 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e3d220-55e7-49aa-a464-47dfd71ae1ca None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:04:42.133288 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e3d220-55e7-49aa-a464-47dfd71ae1ca None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:04:42.164846 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47840cd-d870-4382-91a1-74e5c08a31b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:04:42.165460 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47840cd-d870-4382-91a1-74e5c08a31b0 None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:04:42.165742 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47840cd-d870-4382-91a1-74e5c08a31b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:04:42.166016 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47840cd-d870-4382-91a1-74e5c08a31b0 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:04:42.166707 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47840cd-d870-4382-91a1-74e5c08a31b0 None admin] RBAC: Adding query filter params (interface=public, service_id=70a904f34422494f913c166a5d5b419a, region_id=RegionOne) {{(pid=81765) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:04:42.167013 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47840cd-d870-4382-91a1-74e5c08a31b0 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:04:42.168890 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47840cd-d870-4382-91a1-74e5c08a31b0 None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:04:42.173719 dv-cinder-862365-1-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 484/977] 10.222.0.23 () {56 vars in 1251 bytes} [Fri Oct 28 19:04:42 2022] GET /identity/v3/endpoints?service_id=70a904f34422494f913c166a5d5b419a&interface=public®ion_id=RegionOne => generated 194 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:04:42.179409 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3f5d37-03ec-4f58-a64d-531d769b6e5d None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:04:42.184627 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:04:42.276800 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3f5d37-03ec-4f58-a64d-531d769b6e5d None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:04:42.309835 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb8b22b-4e65-4f66-af21-d063d252331a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:04:42.310426 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb8b22b-4e65-4f66-af21-d063d252331a None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:04:42.310705 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb8b22b-4e65-4f66-af21-d063d252331a None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:04:42.310975 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb8b22b-4e65-4f66-af21-d063d252331a None admin] PATH_INFO: `/v3/services` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:04:42.311561 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb8b22b-4e65-4f66-af21-d063d252331a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:04:42.312912 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb8b22b-4e65-4f66-af21-d063d252331a None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:04:42.319525 dv-cinder-862365-1-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 494/978] 10.222.0.23 () {56 vars in 1087 bytes} [Fri Oct 28 19:04:42 2022] GET /identity/v3/services => generated 2191 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 19:04:44.448889 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e305e816-70c6-41b0-9a90-873b114b6562 None None] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:04:44.449459 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e305e816-70c6-41b0-9a90-873b114b6562 None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:04:44.449555 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e305e816-70c6-41b0-9a90-873b114b6562 None None] PATH_INFO: `/` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:04:44.450952 dv-cinder-862365-1-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 485/979] 10.222.0.23 () {54 vars in 927 bytes} [Fri Oct 28 19:04:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 19:04:44.456033 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6db24f3-899d-4864-971e-d8aa5bbe12b8 None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:04:44.456483 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6db24f3-899d-4864-971e-d8aa5bbe12b8 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:04:44.456590 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6db24f3-899d-4864-971e-d8aa5bbe12b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:04:44.474489 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-a6db24f3-899d-4864-971e-d8aa5bbe12b8 None None] MFA Rules not processed for user `ae863915635746d1ac19970949de4722`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:04:44.475645 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-a6db24f3-899d-4864-971e-d8aa5bbe12b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:04:44.537326 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:04:44.542591 dv-cinder-862365-1-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 495/980] 10.222.0.23 () {58 vars in 1024 bytes} [Fri Oct 28 19:04:44 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 28 19:04:44.807186 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e305e816-70c6-41b0-9a90-873b114b6562 None None] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:04:44.827149 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:04:44.910889 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e305e816-70c6-41b0-9a90-873b114b6562 None None] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:04:44.943427 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3795ab75-81a7-43e0-be20-f1a73eb71757 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:04:44.944045 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3795ab75-81a7-43e0-be20-f1a73eb71757 None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:04:44.944323 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3795ab75-81a7-43e0-be20-f1a73eb71757 None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:04:44.944594 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3795ab75-81a7-43e0-be20-f1a73eb71757 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:04:44.945162 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3795ab75-81a7-43e0-be20-f1a73eb71757 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:04:44.946559 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3795ab75-81a7-43e0-be20-f1a73eb71757 None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:04:44.955129 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application [None req-3795ab75-81a7-43e0-be20-f1a73eb71757 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Oct 28 19:04:44.955129 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 19:04:44.955129 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 28 19:04:44.955129 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 28 19:04:44.955129 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 28 19:04:44.955129 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 28 19:04:44.955129 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 28 19:04:44.955129 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 28 19:04:44.955129 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Oct 28 19:04:44.955129 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application Oct 28 19:04:44.955129 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 28 19:04:44.955129 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application Oct 28 19:04:44.955129 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 19:04:44.955129 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 19:04:44.955129 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 19:04:44.955129 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 19:04:44.955129 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 19:04:44.956359 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 19:04:44.956359 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 19:04:44.956359 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 19:04:44.956359 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 19:04:44.956359 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 19:04:44.956359 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 19:04:44.956359 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 28 19:04:44.956359 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 28 19:04:44.956359 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 28 19:04:44.956359 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 28 19:04:44.956359 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 19:04:44.956359 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 19:04:44.956359 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 19:04:44.956359 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 19:04:44.956359 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 19:04:44.956359 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 19:04:44.957259 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 19:04:44.957259 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application with Lock( Oct 28 19:04:44.957259 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 19:04:44.957259 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._enter() Oct 28 19:04:44.957259 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 19:04:44.957259 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 19:04:44.957259 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 19:04:44.957259 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.creator() Oct 28 19:04:44.957259 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 19:04:44.957259 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application created_value = creator( Oct 28 19:04:44.957259 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 28 19:04:44.957259 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 28 19:04:44.957259 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Oct 28 19:04:44.957259 dv-cinder-862365-1-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application Oct 28 19:04:44.957259 dv-cinder-862365-1-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 486/981] 10.222.0.23 () {56 vars in 1117 bytes} [Fri Oct 28 19:04:44 2022] GET /identity/v3/services/placement => generated 90 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 19:04:44.962416 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6db24f3-899d-4864-971e-d8aa5bbe12b8 None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:04:45.058967 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6db24f3-899d-4864-971e-d8aa5bbe12b8 None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:04:45.093063 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3a8971-5ba8-4b15-b6e7-042ce0b21723 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:04:45.093678 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3a8971-5ba8-4b15-b6e7-042ce0b21723 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:04:45.093956 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3a8971-5ba8-4b15-b6e7-042ce0b21723 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:04:45.094224 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3a8971-5ba8-4b15-b6e7-042ce0b21723 None admin] PATH_INFO: `/v3/services` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:04:45.094832 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3a8971-5ba8-4b15-b6e7-042ce0b21723 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:04:45.095127 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3a8971-5ba8-4b15-b6e7-042ce0b21723 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:04:45.096469 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3a8971-5ba8-4b15-b6e7-042ce0b21723 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:04:45.104103 dv-cinder-862365-1-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 496/982] 10.222.0.23 () {56 vars in 1116 bytes} [Fri Oct 28 19:04:44 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 19:04:45.107341 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3795ab75-81a7-43e0-be20-f1a73eb71757 None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:04:45.187046 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:04:45.205096 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3795ab75-81a7-43e0-be20-f1a73eb71757 None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:04:45.238539 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f5f3f8-3414-400f-92a9-f7762fb40775 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:04:45.239133 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f5f3f8-3414-400f-92a9-f7762fb40775 None admin] REQUEST_METHOD: `POST` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:04:45.239413 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f5f3f8-3414-400f-92a9-f7762fb40775 None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:04:45.239687 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f5f3f8-3414-400f-92a9-f7762fb40775 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:04:45.240364 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f5f3f8-3414-400f-92a9-f7762fb40775 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:04:45.241782 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f5f3f8-3414-400f-92a9-f7762fb40775 None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:04:45.339581 dv-cinder-862365-1-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 487/983] 10.222.0.23 () {60 vars in 1144 bytes} [Fri Oct 28 19:04:45 2022] POST /identity/v3/endpoints => generated 331 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 19:04:55.098667 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=69 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:04:55.334815 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=30,keystone:INSERT=1 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:10:46.666055 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f844141f-8ebf-4d38-af08-0499d10f4745 None None] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:10:46.666519 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f844141f-8ebf-4d38-af08-0499d10f4745 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:10:46.666723 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f844141f-8ebf-4d38-af08-0499d10f4745 None None] PATH_INFO: `/` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:10:46.673040 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e67170-1f08-4548-8d8a-48828f914d0b None None] REQUEST_METHOD: `POST` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:10:46.674279 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e67170-1f08-4548-8d8a-48828f914d0b None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:10:46.675081 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e67170-1f08-4548-8d8a-48828f914d0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:10:46.678383 dv-cinder-862365-1-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 497/984] 10.222.0.23 () {54 vars in 927 bytes} [Fri Oct 28 19:10:46 2022] GET /identity => generated 270 bytes in 14 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 19:10:46.821069 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.auth.core [None req-77e67170-1f08-4548-8d8a-48828f914d0b None None] MFA Rules not processed for user `ae863915635746d1ac19970949de4722`. Rule list: `[]` (Enabled: `True`). {{(pid=81765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:10:46.821069 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-77e67170-1f08-4548-8d8a-48828f914d0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:10:46.981375 dv-cinder-862365-1-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 488/985] 10.222.0.23 () {58 vars in 1024 bytes} [Fri Oct 28 19:10:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 296 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 19:10:47.271665 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52dc4759-d044-456c-874f-066d3335e042 None None] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:10:47.272022 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52dc4759-d044-456c-874f-066d3335e042 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:10:47.272215 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52dc4759-d044-456c-874f-066d3335e042 None None] PATH_INFO: `/` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:10:47.274520 dv-cinder-862365-1-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 498/986] 10.222.0.23 () {54 vars in 965 bytes} [Fri Oct 28 19:10:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 19:10:47.281434 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181e8393-6345-47eb-bb27-450ab0db7997 None None] REQUEST_METHOD: `POST` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:10:47.282140 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181e8393-6345-47eb-bb27-450ab0db7997 None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:10:47.282620 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181e8393-6345-47eb-bb27-450ab0db7997 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:10:47.379116 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.auth.core [None req-181e8393-6345-47eb-bb27-450ab0db7997 None None] MFA Rules not processed for user `a31a9efd8dc04c9aa64c42a3779c550d`. Rule list: `[]` (Enabled: `True`). {{(pid=81765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:10:47.380456 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-181e8393-6345-47eb-bb27-450ab0db7997 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:10:47.404323 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:10:47.472992 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52dc4759-d044-456c-874f-066d3335e042 None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:10:47.474839 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-52dc4759-d044-456c-874f-066d3335e042 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:10:47.478809 dv-cinder-862365-1-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 489/987] 10.222.0.23 () {58 vars in 1062 bytes} [Fri Oct 28 19:10:47 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 19:10:47.591963 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52dc4759-d044-456c-874f-066d3335e042 None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:10:47.671309 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83bd1215-4ee4-4789-b778-44bdda899c2a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a31a9efd8dc04c9aa64c42a3779c550d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b705897907f042c0818a931052438e1e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:10:47.672019 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bd1215-4ee4-4789-b778-44bdda899c2a service neutron] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:10:47.672103 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bd1215-4ee4-4789-b778-44bdda899c2a service neutron] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:10:47.672381 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bd1215-4ee4-4789-b778-44bdda899c2a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:10:47.674177 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-83bd1215-4ee4-4789-b778-44bdda899c2a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:10:47.744234 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:10:47.820908 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83bd1215-4ee4-4789-b778-44bdda899c2a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:10:47.822595 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83bd1215-4ee4-4789-b778-44bdda899c2a service neutron] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:10:47.857629 dv-cinder-862365-1-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 499/988] 10.222.0.23 () {60 vars in 1365 bytes} [Fri Oct 28 19:10:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 385 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 19:10:50.346055 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52855059-a292-4d67-abd6-f7f483163edf None None] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:10:50.346602 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52855059-a292-4d67-abd6-f7f483163edf None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:10:50.346913 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52855059-a292-4d67-abd6-f7f483163edf None None] PATH_INFO: `/` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:10:50.348393 dv-cinder-862365-1-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 490/989] 10.222.0.23 () {54 vars in 927 bytes} [Fri Oct 28 19:10:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 19:10:50.354751 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb855612-f863-48f9-9a9f-0612a90ca71d None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:10:50.355254 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb855612-f863-48f9-9a9f-0612a90ca71d None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:10:50.355330 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb855612-f863-48f9-9a9f-0612a90ca71d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:10:50.432654 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-cb855612-f863-48f9-9a9f-0612a90ca71d None None] MFA Rules not processed for user `ae863915635746d1ac19970949de4722`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:10:50.433931 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-cb855612-f863-48f9-9a9f-0612a90ca71d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:10:50.531851 dv-cinder-862365-1-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 500/990] 10.222.0.23 () {58 vars in 1024 bytes} [Fri Oct 28 19:10:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 19:10:50.811894 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52855059-a292-4d67-abd6-f7f483163edf None None] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:10:50.813460 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-52855059-a292-4d67-abd6-f7f483163edf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:10:50.917200 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52855059-a292-4d67-abd6-f7f483163edf None None] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:10:50.986197 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:10:50.988575 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75e80b8-86dc-4bbb-9e60-abc7f7c1bbb8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a31a9efd8dc04c9aa64c42a3779c550d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b705897907f042c0818a931052438e1e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:10:50.989168 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75e80b8-86dc-4bbb-9e60-abc7f7c1bbb8 service neutron] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:10:50.989476 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75e80b8-86dc-4bbb-9e60-abc7f7c1bbb8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:10:50.989753 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75e80b8-86dc-4bbb-9e60-abc7f7c1bbb8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:10:50.991337 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-c75e80b8-86dc-4bbb-9e60-abc7f7c1bbb8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:10:51.098720 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75e80b8-86dc-4bbb-9e60-abc7f7c1bbb8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:10:51.100140 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75e80b8-86dc-4bbb-9e60-abc7f7c1bbb8 service neutron] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:10:51.118225 dv-cinder-862365-1-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 491/991] 10.222.0.23 () {60 vars in 1365 bytes} [Fri Oct 28 19:10:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 19:10:53.711667 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ce05ab-93d0-4faa-ae20-45556ecc287d None None] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:10:53.712198 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ce05ab-93d0-4faa-ae20-45556ecc287d None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:10:53.712292 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ce05ab-93d0-4faa-ae20-45556ecc287d None None] PATH_INFO: `/` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:10:53.713605 dv-cinder-862365-1-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 501/992] 10.222.0.23 () {54 vars in 927 bytes} [Fri Oct 28 19:10:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 19:10:53.719099 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350d2fc9-90d8-4c94-900d-eadbfbb7e100 None None] REQUEST_METHOD: `POST` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:10:53.719600 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350d2fc9-90d8-4c94-900d-eadbfbb7e100 None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:10:53.719704 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350d2fc9-90d8-4c94-900d-eadbfbb7e100 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:10:53.784773 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.auth.core [None req-350d2fc9-90d8-4c94-900d-eadbfbb7e100 None None] MFA Rules not processed for user `154626d9963c47efa7bf7e5dd699ae08`. Rule list: `[]` (Enabled: `True`). {{(pid=81765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:10:53.786108 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-350d2fc9-90d8-4c94-900d-eadbfbb7e100 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:10:53.838317 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:10:53.882568 dv-cinder-862365-1-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 492/993] 10.222.0.23 () {58 vars in 1024 bytes} [Fri Oct 28 19:10:53 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 19:10:54.171322 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ce05ab-93d0-4faa-ae20-45556ecc287d None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:10:54.172866 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-d7ce05ab-93d0-4faa-ae20-45556ecc287d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:10:54.183557 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:10:54.278254 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ce05ab-93d0-4faa-ae20-45556ecc287d None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:10:54.350000 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda55f38-a461-4d25-88af-cd15811d32ad service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a31a9efd8dc04c9aa64c42a3779c550d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b705897907f042c0818a931052438e1e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:10:54.350591 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda55f38-a461-4d25-88af-cd15811d32ad service neutron] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:10:54.350869 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda55f38-a461-4d25-88af-cd15811d32ad service neutron] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:10:54.351139 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda55f38-a461-4d25-88af-cd15811d32ad service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:10:54.352754 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-eda55f38-a461-4d25-88af-cd15811d32ad service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:10:54.412685 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:10:54.458626 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda55f38-a461-4d25-88af-cd15811d32ad service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:10:54.459990 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda55f38-a461-4d25-88af-cd15811d32ad service neutron] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:10:54.478087 dv-cinder-862365-1-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 502/994] 10.222.0.23 () {60 vars in 1365 bytes} [Fri Oct 28 19:10:54 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 19:10:57.374416 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3751e2-f9f5-4369-bf76-29a9f3249f82 None None] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:10:57.374950 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3751e2-f9f5-4369-bf76-29a9f3249f82 None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:10:57.374950 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3751e2-f9f5-4369-bf76-29a9f3249f82 None None] PATH_INFO: `/` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:10:57.376308 dv-cinder-862365-1-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 493/995] 10.222.0.23 () {54 vars in 927 bytes} [Fri Oct 28 19:10:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 19:10:57.381464 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d19fd5-8ac9-466b-8968-bb49974e8e2e None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:10:57.381925 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d19fd5-8ac9-466b-8968-bb49974e8e2e None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:10:57.382021 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d19fd5-8ac9-466b-8968-bb49974e8e2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:10:57.447267 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-f6d19fd5-8ac9-466b-8968-bb49974e8e2e None None] MFA Rules not processed for user `ae863915635746d1ac19970949de4722`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:10:57.448478 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-f6d19fd5-8ac9-466b-8968-bb49974e8e2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:10:57.543161 dv-cinder-862365-1-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 503/996] 10.222.0.23 () {58 vars in 1024 bytes} [Fri Oct 28 19:10:57 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 19:10:57.842423 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6c4c0e-2f78-4662-9e84-19f7b4bc54f1 None None] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:10:57.842708 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6c4c0e-2f78-4662-9e84-19f7b4bc54f1 None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:10:57.842981 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6c4c0e-2f78-4662-9e84-19f7b4bc54f1 None None] PATH_INFO: `/` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:10:57.845255 dv-cinder-862365-1-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 494/997] 10.222.0.23 () {54 vars in 965 bytes} [Fri Oct 28 19:10:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 19:10:57.850719 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc29e97-a206-493a-8dbe-1bc500c9c5de None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:10:57.851059 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc29e97-a206-493a-8dbe-1bc500c9c5de None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:10:57.851356 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc29e97-a206-493a-8dbe-1bc500c9c5de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:10:57.874659 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:10:57.928281 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-8bc29e97-a206-493a-8dbe-1bc500c9c5de None None] MFA Rules not processed for user `a31a9efd8dc04c9aa64c42a3779c550d`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:10:57.930050 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-8bc29e97-a206-493a-8dbe-1bc500c9c5de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:10:58.004966 dv-cinder-862365-1-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 504/998] 10.222.0.23 () {58 vars in 1062 bytes} [Fri Oct 28 19:10:57 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 19:10:58.014589 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6c4c0e-2f78-4662-9e84-19f7b4bc54f1 None None] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:10:58.016175 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-6a6c4c0e-2f78-4662-9e84-19f7b4bc54f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:10:58.118481 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6c4c0e-2f78-4662-9e84-19f7b4bc54f1 None None] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:10:58.190549 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248debd3-3bc8-4ad4-b489-cef3f49ea211 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a31a9efd8dc04c9aa64c42a3779c550d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b705897907f042c0818a931052438e1e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:10:58.191149 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248debd3-3bc8-4ad4-b489-cef3f49ea211 service neutron] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:10:58.191427 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248debd3-3bc8-4ad4-b489-cef3f49ea211 service neutron] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:10:58.191695 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248debd3-3bc8-4ad4-b489-cef3f49ea211 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:10:58.193292 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-248debd3-3bc8-4ad4-b489-cef3f49ea211 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:10:58.200184 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:10:58.301407 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248debd3-3bc8-4ad4-b489-cef3f49ea211 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:10:58.302832 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248debd3-3bc8-4ad4-b489-cef3f49ea211 service neutron] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:10:58.320671 dv-cinder-862365-1-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 495/999] 10.222.0.23 () {60 vars in 1365 bytes} [Fri Oct 28 19:10:58 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 19:11:01.926320 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef17e61c-9a00-48fe-900d-7df3d76a47ca None None] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:11:01.926867 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef17e61c-9a00-48fe-900d-7df3d76a47ca None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:11:01.926977 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef17e61c-9a00-48fe-900d-7df3d76a47ca None None] PATH_INFO: `/` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:11:01.928238 dv-cinder-862365-1-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 505/1000] 10.222.0.23 () {54 vars in 927 bytes} [Fri Oct 28 19:11:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 19:11:01.934323 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fd30b1-a415-4343-a6f1-a5d5b7c2d915 None None] REQUEST_METHOD: `POST` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:11:01.934744 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fd30b1-a415-4343-a6f1-a5d5b7c2d915 None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:11:01.934883 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fd30b1-a415-4343-a6f1-a5d5b7c2d915 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:11:02.001082 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.auth.core [None req-d9fd30b1-a415-4343-a6f1-a5d5b7c2d915 None None] MFA Rules not processed for user `ae863915635746d1ac19970949de4722`. Rule list: `[]` (Enabled: `True`). {{(pid=81765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:11:02.002330 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-d9fd30b1-a415-4343-a6f1-a5d5b7c2d915 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:11:02.065149 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:11:02.107407 dv-cinder-862365-1-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 496/1001] 10.222.0.23 () {58 vars in 1024 bytes} [Fri Oct 28 19:11:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 19:11:02.390487 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef17e61c-9a00-48fe-900d-7df3d76a47ca None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:11:02.392135 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-ef17e61c-9a00-48fe-900d-7df3d76a47ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:11:02.496044 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef17e61c-9a00-48fe-900d-7df3d76a47ca None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:11:02.508363 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:11:02.581936 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44799d3a-f7d0-40d8-9a09-1f9dcb8ae759 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a31a9efd8dc04c9aa64c42a3779c550d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b705897907f042c0818a931052438e1e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:11:02.582937 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44799d3a-f7d0-40d8-9a09-1f9dcb8ae759 service neutron] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:11:02.583407 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44799d3a-f7d0-40d8-9a09-1f9dcb8ae759 service neutron] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:11:02.583870 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44799d3a-f7d0-40d8-9a09-1f9dcb8ae759 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:11:02.587272 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-44799d3a-f7d0-40d8-9a09-1f9dcb8ae759 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:11:02.736369 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44799d3a-f7d0-40d8-9a09-1f9dcb8ae759 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:11:02.737842 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44799d3a-f7d0-40d8-9a09-1f9dcb8ae759 service neutron] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:11:02.756016 dv-cinder-862365-1-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 506/1002] 10.222.0.23 () {60 vars in 1365 bytes} [Fri Oct 28 19:11:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 19:11:04.997853 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff798262-4740-4899-86c4-a7f641049aa1 None None] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:11:04.998425 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff798262-4740-4899-86c4-a7f641049aa1 None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:11:04.998425 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff798262-4740-4899-86c4-a7f641049aa1 None None] PATH_INFO: `/` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:11:04.999745 dv-cinder-862365-1-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 497/1003] 10.222.0.23 () {54 vars in 927 bytes} [Fri Oct 28 19:11:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 19:11:05.004919 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ac8b27-9b39-49c2-aa8e-96f3e07d9405 None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:11:05.005320 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ac8b27-9b39-49c2-aa8e-96f3e07d9405 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:11:05.005501 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ac8b27-9b39-49c2-aa8e-96f3e07d9405 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:11:05.054408 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:11:05.072587 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-10ac8b27-9b39-49c2-aa8e-96f3e07d9405 None None] MFA Rules not processed for user `ae863915635746d1ac19970949de4722`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:11:05.073865 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-10ac8b27-9b39-49c2-aa8e-96f3e07d9405 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:11:05.180413 dv-cinder-862365-1-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 507/1004] 10.222.0.23 () {58 vars in 1024 bytes} [Fri Oct 28 19:11:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 19:11:05.469982 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff798262-4740-4899-86c4-a7f641049aa1 None None] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:11:05.471542 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-ff798262-4740-4899-86c4-a7f641049aa1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:11:05.574795 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff798262-4740-4899-86c4-a7f641049aa1 None None] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:11:05.647993 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9a5129-cd2a-4c1b-8ad9-61ba8964cb3c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a31a9efd8dc04c9aa64c42a3779c550d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b705897907f042c0818a931052438e1e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:11:05.648630 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9a5129-cd2a-4c1b-8ad9-61ba8964cb3c service neutron] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:11:05.648910 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9a5129-cd2a-4c1b-8ad9-61ba8964cb3c service neutron] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:11:05.649224 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9a5129-cd2a-4c1b-8ad9-61ba8964cb3c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:11:05.650864 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-ee9a5129-cd2a-4c1b-8ad9-61ba8964cb3c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:11:05.668073 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:11:05.762039 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9a5129-cd2a-4c1b-8ad9-61ba8964cb3c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:11:05.763477 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9a5129-cd2a-4c1b-8ad9-61ba8964cb3c service neutron] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:11:05.782579 dv-cinder-862365-1-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 498/1005] 10.222.0.23 () {60 vars in 1365 bytes} [Fri Oct 28 19:11:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 19:11:08.013689 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79cc322-b140-4a92-82ae-959b94506989 None None] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:11:08.014196 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79cc322-b140-4a92-82ae-959b94506989 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:11:08.014319 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79cc322-b140-4a92-82ae-959b94506989 None None] PATH_INFO: `/` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:11:08.015562 dv-cinder-862365-1-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 508/1006] 10.222.0.23 () {54 vars in 927 bytes} [Fri Oct 28 19:11:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 19:11:08.020984 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ac1d14-0b59-48e8-acdd-b23a46bda897 None None] REQUEST_METHOD: `POST` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:11:08.021431 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ac1d14-0b59-48e8-acdd-b23a46bda897 None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:11:08.021582 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ac1d14-0b59-48e8-acdd-b23a46bda897 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:11:08.089249 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.auth.core [None req-b5ac1d14-0b59-48e8-acdd-b23a46bda897 None None] MFA Rules not processed for user `154626d9963c47efa7bf7e5dd699ae08`. Rule list: `[]` (Enabled: `True`). {{(pid=81765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:11:08.090518 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-b5ac1d14-0b59-48e8-acdd-b23a46bda897 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:11:08.155425 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:11:08.186253 dv-cinder-862365-1-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 499/1007] 10.222.0.23 () {58 vars in 1024 bytes} [Fri Oct 28 19:11:08 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 19:11:08.468334 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79cc322-b140-4a92-82ae-959b94506989 None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:11:08.470225 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-a79cc322-b140-4a92-82ae-959b94506989 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:11:08.576916 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79cc322-b140-4a92-82ae-959b94506989 None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:11:08.599533 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:11:08.653109 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1358fc25-7384-4e10-9a69-e731f66a5da6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a31a9efd8dc04c9aa64c42a3779c550d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b705897907f042c0818a931052438e1e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:11:08.653742 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1358fc25-7384-4e10-9a69-e731f66a5da6 service neutron] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:11:08.654021 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1358fc25-7384-4e10-9a69-e731f66a5da6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:11:08.654301 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1358fc25-7384-4e10-9a69-e731f66a5da6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:11:08.655890 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-1358fc25-7384-4e10-9a69-e731f66a5da6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:11:08.780791 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1358fc25-7384-4e10-9a69-e731f66a5da6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:11:08.782274 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1358fc25-7384-4e10-9a69-e731f66a5da6 service neutron] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:11:08.801150 dv-cinder-862365-1-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 509/1008] 10.222.0.23 () {60 vars in 1365 bytes} [Fri Oct 28 19:11:08 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 19:11:11.369196 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0430c59c-91d8-42c3-b9a0-da1f57799bd0 None None] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:11:11.369803 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0430c59c-91d8-42c3-b9a0-da1f57799bd0 None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:11:11.369803 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0430c59c-91d8-42c3-b9a0-da1f57799bd0 None None] PATH_INFO: `/` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:11:11.371157 dv-cinder-862365-1-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 500/1009] 10.222.0.23 () {54 vars in 927 bytes} [Fri Oct 28 19:11:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 19:11:11.376251 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23da4a6a-b387-47c1-ae40-7f20545e8029 None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:11:11.376673 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23da4a6a-b387-47c1-ae40-7f20545e8029 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:11:11.376793 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23da4a6a-b387-47c1-ae40-7f20545e8029 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:11:11.444359 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:11:11.447802 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-23da4a6a-b387-47c1-ae40-7f20545e8029 None None] MFA Rules not processed for user `ae863915635746d1ac19970949de4722`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:11:11.449030 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-23da4a6a-b387-47c1-ae40-7f20545e8029 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:11:11.545180 dv-cinder-862365-1-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 510/1010] 10.222.0.23 () {58 vars in 1024 bytes} [Fri Oct 28 19:11:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 19:11:11.826704 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0430c59c-91d8-42c3-b9a0-da1f57799bd0 None None] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:11:11.828351 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-0430c59c-91d8-42c3-b9a0-da1f57799bd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:11:11.930849 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0430c59c-91d8-42c3-b9a0-da1f57799bd0 None None] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:11:12.002672 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58f2869-34fc-4738-8d83-3faab0dcb729 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a31a9efd8dc04c9aa64c42a3779c550d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b705897907f042c0818a931052438e1e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:11:12.003264 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58f2869-34fc-4738-8d83-3faab0dcb729 service neutron] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:11:12.003542 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58f2869-34fc-4738-8d83-3faab0dcb729 service neutron] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:11:12.003811 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58f2869-34fc-4738-8d83-3faab0dcb729 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:11:12.005403 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-a58f2869-34fc-4738-8d83-3faab0dcb729 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:11:12.032396 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:11:12.111967 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58f2869-34fc-4738-8d83-3faab0dcb729 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:11:12.113313 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58f2869-34fc-4738-8d83-3faab0dcb729 service neutron] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:11:12.133489 dv-cinder-862365-1-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 501/1011] 10.222.0.23 () {60 vars in 1365 bytes} [Fri Oct 28 19:11:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 19:11:14.355999 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75616cd-7f83-499d-a4ee-2c77b2292ef6 None None] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:11:14.402641 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75616cd-7f83-499d-a4ee-2c77b2292ef6 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:11:14.402641 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75616cd-7f83-499d-a4ee-2c77b2292ef6 None None] PATH_INFO: `/` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:11:14.402641 dv-cinder-862365-1-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 511/1012] 10.222.0.23 () {54 vars in 927 bytes} [Fri Oct 28 19:11:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 19:11:14.402957 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77aeab12-db75-4685-9ed6-16f8dc0359a1 None None] REQUEST_METHOD: `POST` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:11:14.402957 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77aeab12-db75-4685-9ed6-16f8dc0359a1 None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:11:14.402957 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77aeab12-db75-4685-9ed6-16f8dc0359a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:11:14.428087 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.auth.core [None req-77aeab12-db75-4685-9ed6-16f8dc0359a1 None None] MFA Rules not processed for user `ae863915635746d1ac19970949de4722`. Rule list: `[]` (Enabled: `True`). {{(pid=81765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:11:14.429842 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-77aeab12-db75-4685-9ed6-16f8dc0359a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:11:14.503075 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:11:14.525195 dv-cinder-862365-1-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 502/1013] 10.222.0.23 () {58 vars in 1024 bytes} [Fri Oct 28 19:11:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 19:11:14.810967 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75616cd-7f83-499d-a4ee-2c77b2292ef6 None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:11:14.812510 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-b75616cd-7f83-499d-a4ee-2c77b2292ef6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:11:14.915243 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75616cd-7f83-499d-a4ee-2c77b2292ef6 None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:11:14.943608 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:11:14.987754 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c95dc99-7d43-4b87-9c8d-8168238a5d67 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a31a9efd8dc04c9aa64c42a3779c550d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b705897907f042c0818a931052438e1e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:11:14.988342 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c95dc99-7d43-4b87-9c8d-8168238a5d67 service neutron] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:11:14.988614 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c95dc99-7d43-4b87-9c8d-8168238a5d67 service neutron] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:11:14.988878 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c95dc99-7d43-4b87-9c8d-8168238a5d67 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:11:14.990509 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-7c95dc99-7d43-4b87-9c8d-8168238a5d67 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:11:15.096262 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c95dc99-7d43-4b87-9c8d-8168238a5d67 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:11:15.097708 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c95dc99-7d43-4b87-9c8d-8168238a5d67 service neutron] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:11:15.115566 dv-cinder-862365-1-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 512/1014] 10.222.0.23 () {60 vars in 1365 bytes} [Fri Oct 28 19:11:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 19:11:17.825317 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44aa3e89-0c1b-48d5-9886-ebca1b3e8ae9 None None] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:11:17.825906 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44aa3e89-0c1b-48d5-9886-ebca1b3e8ae9 None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:11:17.825906 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44aa3e89-0c1b-48d5-9886-ebca1b3e8ae9 None None] PATH_INFO: `/` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:11:17.827254 dv-cinder-862365-1-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 503/1015] 10.222.0.23 () {54 vars in 927 bytes} [Fri Oct 28 19:11:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 19:11:17.832674 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29907b59-c60e-4204-888e-c1d399878768 None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:11:17.833128 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29907b59-c60e-4204-888e-c1d399878768 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:11:17.833128 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29907b59-c60e-4204-888e-c1d399878768 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:11:17.898770 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-29907b59-c60e-4204-888e-c1d399878768 None None] MFA Rules not processed for user `ae863915635746d1ac19970949de4722`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:11:17.900511 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-29907b59-c60e-4204-888e-c1d399878768 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:11:17.908786 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:11:17.996205 dv-cinder-862365-1-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 513/1016] 10.222.0.23 () {58 vars in 1024 bytes} [Fri Oct 28 19:11:17 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 19:11:18.281761 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44aa3e89-0c1b-48d5-9886-ebca1b3e8ae9 None None] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:11:18.283376 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-44aa3e89-0c1b-48d5-9886-ebca1b3e8ae9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:11:18.385073 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44aa3e89-0c1b-48d5-9886-ebca1b3e8ae9 None None] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:11:18.457129 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bcc0875-4691-447b-b28d-302e35184fe5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a31a9efd8dc04c9aa64c42a3779c550d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b705897907f042c0818a931052438e1e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:11:18.457758 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcc0875-4691-447b-b28d-302e35184fe5 service neutron] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:11:18.458038 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcc0875-4691-447b-b28d-302e35184fe5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:11:18.458310 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcc0875-4691-447b-b28d-302e35184fe5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:11:18.459885 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-6bcc0875-4691-447b-b28d-302e35184fe5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:11:18.495537 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:11:18.567220 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bcc0875-4691-447b-b28d-302e35184fe5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:11:18.568576 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bcc0875-4691-447b-b28d-302e35184fe5 service neutron] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:11:18.588694 dv-cinder-862365-1-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 504/1017] 10.222.0.23 () {60 vars in 1365 bytes} [Fri Oct 28 19:11:18 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 19:11:22.976263 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e6beb7-13e9-49d3-a5ef-025fd31ec453 None None] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:11:22.976763 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e6beb7-13e9-49d3-a5ef-025fd31ec453 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:11:22.976763 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e6beb7-13e9-49d3-a5ef-025fd31ec453 None None] PATH_INFO: `/` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:11:22.978642 dv-cinder-862365-1-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 514/1018] 10.222.0.23 () {54 vars in 927 bytes} [Fri Oct 28 19:11:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 19:11:22.983942 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3444b3-e5a6-4328-abd0-ff1cc5bc36ad None None] REQUEST_METHOD: `POST` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:11:22.984366 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3444b3-e5a6-4328-abd0-ff1cc5bc36ad None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:11:22.984503 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3444b3-e5a6-4328-abd0-ff1cc5bc36ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:11:23.050093 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.auth.core [None req-eb3444b3-e5a6-4328-abd0-ff1cc5bc36ad None None] MFA Rules not processed for user `ae863915635746d1ac19970949de4722`. Rule list: `[]` (Enabled: `True`). {{(pid=81765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:11:23.051305 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-eb3444b3-e5a6-4328-abd0-ff1cc5bc36ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:11:23.136628 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:11:23.147652 dv-cinder-862365-1-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 505/1019] 10.222.0.23 () {58 vars in 1024 bytes} [Fri Oct 28 19:11:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 19:11:23.431089 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e6beb7-13e9-49d3-a5ef-025fd31ec453 None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:11:23.432624 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-c3e6beb7-13e9-49d3-a5ef-025fd31ec453 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:11:23.536613 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e6beb7-13e9-49d3-a5ef-025fd31ec453 None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:11:23.585824 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:11:23.622051 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cce68c0-91cc-4e54-8aee-3f16e9d351fd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a31a9efd8dc04c9aa64c42a3779c550d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b705897907f042c0818a931052438e1e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:11:23.622842 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cce68c0-91cc-4e54-8aee-3f16e9d351fd service neutron] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:11:23.623287 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cce68c0-91cc-4e54-8aee-3f16e9d351fd service neutron] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:11:23.623872 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cce68c0-91cc-4e54-8aee-3f16e9d351fd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:11:23.625505 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-9cce68c0-91cc-4e54-8aee-3f16e9d351fd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:11:23.732817 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cce68c0-91cc-4e54-8aee-3f16e9d351fd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:11:23.734201 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cce68c0-91cc-4e54-8aee-3f16e9d351fd service neutron] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:11:23.752435 dv-cinder-862365-1-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 515/1020] 10.222.0.23 () {60 vars in 1365 bytes} [Fri Oct 28 19:11:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 28 19:11:26.847644 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccb746f-3549-453c-b1f9-40faeeae03e6 None None] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:11:26.848042 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccb746f-3549-453c-b1f9-40faeeae03e6 None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:11:26.848201 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccb746f-3549-453c-b1f9-40faeeae03e6 None None] PATH_INFO: `/` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:11:26.849591 dv-cinder-862365-1-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 506/1021] 10.222.0.23 () {54 vars in 927 bytes} [Fri Oct 28 19:11:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 28 19:11:26.854749 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f4c880-75c4-4f73-b205-f66c0e6f3d22 None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:11:26.855147 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f4c880-75c4-4f73-b205-f66c0e6f3d22 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:11:26.855420 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f4c880-75c4-4f73-b205-f66c0e6f3d22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:11:26.921729 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-21f4c880-75c4-4f73-b205-f66c0e6f3d22 None None] MFA Rules not processed for user `ae863915635746d1ac19970949de4722`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:11:26.922932 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-21f4c880-75c4-4f73-b205-f66c0e6f3d22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:11:26.940889 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:11:27.022050 dv-cinder-862365-1-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 516/1022] 10.222.0.23 () {58 vars in 1024 bytes} [Fri Oct 28 19:11:26 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 19:11:27.305713 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cccb746f-3549-453c-b1f9-40faeeae03e6 None None] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:11:27.307248 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-cccb746f-3549-453c-b1f9-40faeeae03e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:11:27.410637 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cccb746f-3549-453c-b1f9-40faeeae03e6 None None] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:11:27.489488 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a2b95f-144a-4a0d-8b3f-37efacb095b0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a31a9efd8dc04c9aa64c42a3779c550d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b705897907f042c0818a931052438e1e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:11:27.490101 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a2b95f-144a-4a0d-8b3f-37efacb095b0 service neutron] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:11:27.490380 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a2b95f-144a-4a0d-8b3f-37efacb095b0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:11:27.490649 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a2b95f-144a-4a0d-8b3f-37efacb095b0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:11:27.492278 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-98a2b95f-144a-4a0d-8b3f-37efacb095b0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:11:27.543722 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:11:27.623996 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a2b95f-144a-4a0d-8b3f-37efacb095b0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:11:27.625583 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a2b95f-144a-4a0d-8b3f-37efacb095b0 service neutron] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:11:27.645970 dv-cinder-862365-1-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 507/1023] 10.222.0.23 () {60 vars in 1365 bytes} [Fri Oct 28 19:11:27 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 19:11:32.170290 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be649289-70d8-4842-a268-b4f0dda67bcc None None] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:11:32.170747 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be649289-70d8-4842-a268-b4f0dda67bcc None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:11:32.170861 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be649289-70d8-4842-a268-b4f0dda67bcc None None] PATH_INFO: `/` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:11:32.172232 dv-cinder-862365-1-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 517/1024] 10.222.0.23 () {54 vars in 927 bytes} [Fri Oct 28 19:11:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 19:11:32.177547 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7adb45-70c7-4a22-bda2-5575417b1e09 None None] REQUEST_METHOD: `POST` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:11:32.177942 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7adb45-70c7-4a22-bda2-5575417b1e09 None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:11:32.178090 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7adb45-70c7-4a22-bda2-5575417b1e09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:11:32.248585 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.auth.core [None req-8a7adb45-70c7-4a22-bda2-5575417b1e09 None None] MFA Rules not processed for user `ae863915635746d1ac19970949de4722`. Rule list: `[]` (Enabled: `True`). {{(pid=81765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:11:32.249885 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-8a7adb45-70c7-4a22-bda2-5575417b1e09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:11:32.345120 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:11:32.347483 dv-cinder-862365-1-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 508/1025] 10.222.0.23 () {58 vars in 1024 bytes} [Fri Oct 28 19:11:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 19:11:32.628197 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be649289-70d8-4842-a268-b4f0dda67bcc None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:11:32.629783 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-be649289-70d8-4842-a268-b4f0dda67bcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:11:32.740559 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be649289-70d8-4842-a268-b4f0dda67bcc None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:11:32.791379 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:11:32.817986 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ffc67f4-e81d-4d38-8716-d71aef21af57 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a31a9efd8dc04c9aa64c42a3779c550d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b705897907f042c0818a931052438e1e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:11:32.818595 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffc67f4-e81d-4d38-8716-d71aef21af57 service neutron] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:11:32.818873 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffc67f4-e81d-4d38-8716-d71aef21af57 service neutron] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:11:32.819144 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffc67f4-e81d-4d38-8716-d71aef21af57 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:11:32.820914 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-6ffc67f4-e81d-4d38-8716-d71aef21af57 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:11:32.939151 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ffc67f4-e81d-4d38-8716-d71aef21af57 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:11:32.940540 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ffc67f4-e81d-4d38-8716-d71aef21af57 service neutron] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:11:32.962223 dv-cinder-862365-1-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 518/1026] 10.222.0.23 () {60 vars in 1365 bytes} [Fri Oct 28 19:11:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 19:11:37.925581 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b76bd3-817b-4b8e-a806-752bf268ddf3 None None] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:11:37.926079 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b76bd3-817b-4b8e-a806-752bf268ddf3 None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:11:37.926220 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b76bd3-817b-4b8e-a806-752bf268ddf3 None None] PATH_INFO: `/` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:11:37.927825 dv-cinder-862365-1-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 509/1027] 10.222.0.23 () {54 vars in 921 bytes} [Fri Oct 28 19:11:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 19:11:37.933868 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2392d110-4486-4b1b-9496-4efbbebdf2e1 None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:11:37.934291 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2392d110-4486-4b1b-9496-4efbbebdf2e1 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:11:37.934935 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2392d110-4486-4b1b-9496-4efbbebdf2e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:11:38.050303 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-2392d110-4486-4b1b-9496-4efbbebdf2e1 None None] MFA Rules not processed for user `c3308c9156d44c5599514ffaf708d4b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:11:38.050303 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-2392d110-4486-4b1b-9496-4efbbebdf2e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:11:38.096073 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:11:38.198796 dv-cinder-862365-1-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 519/1028] 10.222.0.23 () {58 vars in 1018 bytes} [Fri Oct 28 19:11:37 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 266 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 19:11:42.262330 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817fc409-62e8-4d1d-9400-7fd86e428cc6 None None] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:11:42.262846 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817fc409-62e8-4d1d-9400-7fd86e428cc6 None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:11:42.262846 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817fc409-62e8-4d1d-9400-7fd86e428cc6 None None] PATH_INFO: `/` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:11:42.264374 dv-cinder-862365-1-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 510/1029] 10.222.0.23 () {54 vars in 921 bytes} [Fri Oct 28 19:11:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 19:11:42.269244 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d09095-be0d-4799-815b-e376633d39e2 None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:11:42.269737 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d09095-be0d-4799-815b-e376633d39e2 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:11:42.269822 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d09095-be0d-4799-815b-e376633d39e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:11:42.350805 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-16d09095-be0d-4799-815b-e376633d39e2 None None] MFA Rules not processed for user `c3308c9156d44c5599514ffaf708d4b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:11:42.352573 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-16d09095-be0d-4799-815b-e376633d39e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:11:42.430347 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:11:42.468174 dv-cinder-862365-1-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 520/1030] 10.222.0.23 () {58 vars in 1018 bytes} [Fri Oct 28 19:11:42 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 19:11:43.912977 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfb95a6-7c11-44ae-b2db-2b04adeb3116 None None] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:11:43.913568 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfb95a6-7c11-44ae-b2db-2b04adeb3116 None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:11:43.913568 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfb95a6-7c11-44ae-b2db-2b04adeb3116 None None] PATH_INFO: `/` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:11:43.914945 dv-cinder-862365-1-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 511/1031] 10.222.0.23 () {54 vars in 921 bytes} [Fri Oct 28 19:11:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 19:11:43.920009 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6d2888-2e78-44ff-8cf2-c7c42e6d48a1 None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:11:43.920798 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6d2888-2e78-44ff-8cf2-c7c42e6d48a1 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:11:43.921073 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6d2888-2e78-44ff-8cf2-c7c42e6d48a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:11:43.998634 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-5b6d2888-2e78-44ff-8cf2-c7c42e6d48a1 None None] MFA Rules not processed for user `c3308c9156d44c5599514ffaf708d4b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:11:43.999836 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-5b6d2888-2e78-44ff-8cf2-c7c42e6d48a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:11:44.106336 dv-cinder-862365-1-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 521/1032] 10.222.0.23 () {58 vars in 1018 bytes} [Fri Oct 28 19:11:43 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 19:11:47.716024 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e9da7b-c7ae-410b-a342-2929a57e0031 None None] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:11:47.716517 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e9da7b-c7ae-410b-a342-2929a57e0031 None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:11:47.716517 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e9da7b-c7ae-410b-a342-2929a57e0031 None None] PATH_INFO: `/` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:11:47.717984 dv-cinder-862365-1-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 512/1033] 10.222.0.23 () {54 vars in 927 bytes} [Fri Oct 28 19:11:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 19:11:47.723527 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8f443b-839b-45dc-a527-e1ebd5c6f1e4 None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:11:47.723951 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8f443b-839b-45dc-a527-e1ebd5c6f1e4 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:11:47.724068 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8f443b-839b-45dc-a527-e1ebd5c6f1e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:11:47.763408 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:11:47.795044 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-4b8f443b-839b-45dc-a527-e1ebd5c6f1e4 None None] MFA Rules not processed for user `ae863915635746d1ac19970949de4722`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:11:47.796148 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-4b8f443b-839b-45dc-a527-e1ebd5c6f1e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:11:47.907942 dv-cinder-862365-1-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 522/1034] 10.222.0.23 () {58 vars in 1024 bytes} [Fri Oct 28 19:11:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 19:11:48.208237 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb394306-62ac-4edd-84c7-4afe75519c3a None None] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:11:48.208519 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb394306-62ac-4edd-84c7-4afe75519c3a None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:11:48.209039 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb394306-62ac-4edd-84c7-4afe75519c3a None None] PATH_INFO: `/` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:11:48.210608 dv-cinder-862365-1-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 513/1035] 10.222.0.23 () {54 vars in 961 bytes} [Fri Oct 28 19:11:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 19:11:48.221131 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962b6233-8bba-47c2-b151-fb2e99eee503 None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:11:48.221681 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962b6233-8bba-47c2-b151-fb2e99eee503 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:11:48.222280 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962b6233-8bba-47c2-b151-fb2e99eee503 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:11:48.310232 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-962b6233-8bba-47c2-b151-fb2e99eee503 None None] MFA Rules not processed for user `8877180cd9844dad8b0980de34769ec8`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:11:48.311430 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-962b6233-8bba-47c2-b151-fb2e99eee503 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:11:48.363022 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:11:48.441564 dv-cinder-862365-1-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 523/1036] 10.222.0.23 () {58 vars in 1058 bytes} [Fri Oct 28 19:11:48 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 19:11:48.450267 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb394306-62ac-4edd-84c7-4afe75519c3a None None] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:11:48.451880 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-fb394306-62ac-4edd-84c7-4afe75519c3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:11:48.606359 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb394306-62ac-4edd-84c7-4afe75519c3a None None] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:11:48.681629 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:11:48.722294 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65076753-66de-414b-9efb-d8101017669a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8877180cd9844dad8b0980de34769ec8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b705897907f042c0818a931052438e1e', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:11:48.722903 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65076753-66de-414b-9efb-d8101017669a service nova] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:11:48.723180 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65076753-66de-414b-9efb-d8101017669a service nova] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:11:48.723456 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65076753-66de-414b-9efb-d8101017669a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:11:48.725067 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-65076753-66de-414b-9efb-d8101017669a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:11:48.832996 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65076753-66de-414b-9efb-d8101017669a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:11:48.834628 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65076753-66de-414b-9efb-d8101017669a service nova] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:11:48.857146 dv-cinder-862365-1-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 514/1037] 10.222.0.23 () {60 vars in 1365 bytes} [Fri Oct 28 19:11:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 407 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 19:11:51.274544 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1811b8-3c34-40e6-8559-796c4f6e43a8 None None] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:11:51.275196 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1811b8-3c34-40e6-8559-796c4f6e43a8 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:11:51.275196 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1811b8-3c34-40e6-8559-796c4f6e43a8 None None] PATH_INFO: `/` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:11:51.284356 dv-cinder-862365-1-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 524/1038] 10.222.0.23 () {54 vars in 927 bytes} [Fri Oct 28 19:11:51 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 19:11:51.284574 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134ec783-03f4-4df5-a289-f42d1e0af01a None None] REQUEST_METHOD: `POST` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:11:51.284574 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134ec783-03f4-4df5-a289-f42d1e0af01a None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:11:51.284574 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134ec783-03f4-4df5-a289-f42d1e0af01a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:11:51.377978 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.auth.core [None req-134ec783-03f4-4df5-a289-f42d1e0af01a None None] MFA Rules not processed for user `ae863915635746d1ac19970949de4722`. Rule list: `[]` (Enabled: `True`). {{(pid=81765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:11:51.379266 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-134ec783-03f4-4df5-a289-f42d1e0af01a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:11:51.419304 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:11:51.485385 dv-cinder-862365-1-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 515/1039] 10.222.0.23 () {58 vars in 1024 bytes} [Fri Oct 28 19:11:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 19:11:51.775189 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1811b8-3c34-40e6-8559-796c4f6e43a8 None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:11:51.776697 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-fa1811b8-3c34-40e6-8559-796c4f6e43a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:11:51.971135 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1811b8-3c34-40e6-8559-796c4f6e43a8 None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:11:51.986289 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:11:52.107805 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf647c56-5022-4215-bcb4-13434e64d2ee service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8877180cd9844dad8b0980de34769ec8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b705897907f042c0818a931052438e1e', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:11:52.108409 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf647c56-5022-4215-bcb4-13434e64d2ee service nova] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:11:52.108683 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf647c56-5022-4215-bcb4-13434e64d2ee service nova] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:11:52.108951 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf647c56-5022-4215-bcb4-13434e64d2ee service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:11:52.110575 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-cf647c56-5022-4215-bcb4-13434e64d2ee service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:11:52.202384 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf647c56-5022-4215-bcb4-13434e64d2ee service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:11:52.203924 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf647c56-5022-4215-bcb4-13434e64d2ee service nova] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:11:52.222655 dv-cinder-862365-1-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 525/1040] 10.222.0.23 () {60 vars in 1365 bytes} [Fri Oct 28 19:11:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 448 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 19:11:54.836343 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b225470c-dd86-4ffe-bb76-05c4969efb73 None None] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:11:54.836885 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b225470c-dd86-4ffe-bb76-05c4969efb73 None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:11:54.836885 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b225470c-dd86-4ffe-bb76-05c4969efb73 None None] PATH_INFO: `/` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:11:54.838480 dv-cinder-862365-1-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 516/1041] 10.222.0.23 () {54 vars in 927 bytes} [Fri Oct 28 19:11:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 19:11:54.843648 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6095aae8-2d29-46dd-9057-8c9640f58557 None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:11:54.844116 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6095aae8-2d29-46dd-9057-8c9640f58557 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:11:54.844222 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6095aae8-2d29-46dd-9057-8c9640f58557 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:11:54.861021 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:11:54.918152 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-6095aae8-2d29-46dd-9057-8c9640f58557 None None] MFA Rules not processed for user `ae863915635746d1ac19970949de4722`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:11:54.919363 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-6095aae8-2d29-46dd-9057-8c9640f58557 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:11:55.024564 dv-cinder-862365-1-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 526/1042] 10.222.0.23 () {58 vars in 1024 bytes} [Fri Oct 28 19:11:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 19:11:55.316161 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e5732e-5503-4294-b422-dd0ec24e7c41 None None] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:11:55.316589 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e5732e-5503-4294-b422-dd0ec24e7c41 None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:11:55.316960 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e5732e-5503-4294-b422-dd0ec24e7c41 None None] PATH_INFO: `/` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:11:55.318788 dv-cinder-862365-1-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 517/1043] 10.222.0.23 () {54 vars in 961 bytes} [Fri Oct 28 19:11:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 19:11:55.323955 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf4d8ed-6166-4f3a-ae21-5864f796c439 None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:11:55.326259 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf4d8ed-6166-4f3a-ae21-5864f796c439 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:11:55.326259 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf4d8ed-6166-4f3a-ae21-5864f796c439 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:11:55.405369 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-fdf4d8ed-6166-4f3a-ae21-5864f796c439 None None] MFA Rules not processed for user `8877180cd9844dad8b0980de34769ec8`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:11:55.406595 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-fdf4d8ed-6166-4f3a-ae21-5864f796c439 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:11:55.443507 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:11:55.531559 dv-cinder-862365-1-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 527/1044] 10.222.0.23 () {58 vars in 1058 bytes} [Fri Oct 28 19:11:55 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 19:11:55.540051 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e5732e-5503-4294-b422-dd0ec24e7c41 None None] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:11:55.541970 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-39e5732e-5503-4294-b422-dd0ec24e7c41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:11:55.696340 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e5732e-5503-4294-b422-dd0ec24e7c41 None None] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:11:55.716991 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:11:55.818679 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093bc0ec-3d14-4d74-9578-81d99c6616e1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8877180cd9844dad8b0980de34769ec8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b705897907f042c0818a931052438e1e', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:11:55.819292 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093bc0ec-3d14-4d74-9578-81d99c6616e1 service nova] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:11:55.819573 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093bc0ec-3d14-4d74-9578-81d99c6616e1 service nova] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:11:55.819851 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093bc0ec-3d14-4d74-9578-81d99c6616e1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:11:55.821572 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-093bc0ec-3d14-4d74-9578-81d99c6616e1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:11:55.903394 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646d324c-038c-47f5-95f3-533b6763f2d7 None None] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:11:55.903928 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646d324c-038c-47f5-95f3-533b6763f2d7 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:11:55.903928 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646d324c-038c-47f5-95f3-533b6763f2d7 None None] PATH_INFO: `/` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:11:55.905262 dv-cinder-862365-1-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 528/1045] 10.222.0.23 () {54 vars in 927 bytes} [Fri Oct 28 19:11:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 28 19:11:55.910242 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc833e9a-3f46-4d42-a4c1-9b0a6709b304 None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:11:55.910527 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc833e9a-3f46-4d42-a4c1-9b0a6709b304 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:11:55.910802 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc833e9a-3f46-4d42-a4c1-9b0a6709b304 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:11:55.922127 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-093bc0ec-3d14-4d74-9578-81d99c6616e1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:11:55.924524 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-093bc0ec-3d14-4d74-9578-81d99c6616e1 service nova] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:11:55.945814 dv-cinder-862365-1-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 518/1046] 10.222.0.23 () {60 vars in 1365 bytes} [Fri Oct 28 19:11:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 407 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 19:11:55.977740 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-bc833e9a-3f46-4d42-a4c1-9b0a6709b304 None None] MFA Rules not processed for user `ae863915635746d1ac19970949de4722`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:11:55.982030 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-bc833e9a-3f46-4d42-a4c1-9b0a6709b304 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:11:56.080464 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:11:56.088381 dv-cinder-862365-1-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 529/1047] 10.222.0.23 () {58 vars in 1024 bytes} [Fri Oct 28 19:11:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 19:11:56.428382 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ead523a-1b71-4868-9bb4-d80eeaeeef7b None None] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:11:56.428382 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ead523a-1b71-4868-9bb4-d80eeaeeef7b None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:11:56.428382 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ead523a-1b71-4868-9bb4-d80eeaeeef7b None None] PATH_INFO: `/` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:11:56.428382 dv-cinder-862365-1-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 519/1048] 10.222.0.23 () {54 vars in 963 bytes} [Fri Oct 28 19:11:56 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 19:11:56.433108 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955319b0-5e5e-44c6-a641-95a960ecc5c2 None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:11:56.433587 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955319b0-5e5e-44c6-a641-95a960ecc5c2 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:11:56.433798 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955319b0-5e5e-44c6-a641-95a960ecc5c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:11:56.517865 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-955319b0-5e5e-44c6-a641-95a960ecc5c2 None None] MFA Rules not processed for user `c855af0d7b0746d2b8fdf3f0b8e58cd3`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:11:56.519065 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-955319b0-5e5e-44c6-a641-95a960ecc5c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:11:56.601094 dv-cinder-862365-1-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 530/1049] 10.222.0.23 () {58 vars in 1060 bytes} [Fri Oct 28 19:11:56 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 19:11:56.610143 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ead523a-1b71-4868-9bb4-d80eeaeeef7b None None] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:11:56.611826 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-5ead523a-1b71-4868-9bb4-d80eeaeeef7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:11:56.643604 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:11:56.721978 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ead523a-1b71-4868-9bb4-d80eeaeeef7b None None] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:11:56.800499 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b55f3f-e3e6-42e6-a723-e265644bb6d5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c855af0d7b0746d2b8fdf3f0b8e58cd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b705897907f042c0818a931052438e1e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:11:56.801020 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b55f3f-e3e6-42e6-a723-e265644bb6d5 service cinder] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:11:56.801294 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b55f3f-e3e6-42e6-a723-e265644bb6d5 service cinder] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:11:56.801595 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b55f3f-e3e6-42e6-a723-e265644bb6d5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:11:56.803189 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-05b55f3f-e3e6-42e6-a723-e265644bb6d5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:11:56.897660 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:11:56.931511 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b55f3f-e3e6-42e6-a723-e265644bb6d5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:11:56.933010 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b55f3f-e3e6-42e6-a723-e265644bb6d5 service cinder] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:11:56.951891 dv-cinder-862365-1-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 520/1050] 10.222.0.23 () {60 vars in 1365 bytes} [Fri Oct 28 19:11:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 19:11:58.340508 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3542b5-b396-4c9f-9b92-0910358324b6 None None] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:11:58.341069 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3542b5-b396-4c9f-9b92-0910358324b6 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:11:58.341069 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3542b5-b396-4c9f-9b92-0910358324b6 None None] PATH_INFO: `/` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:11:58.342516 dv-cinder-862365-1-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 531/1051] 10.222.0.23 () {54 vars in 927 bytes} [Fri Oct 28 19:11:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 19:11:58.348043 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f2c061-5729-47e2-9ebf-094e1d1e06b0 None None] REQUEST_METHOD: `POST` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:11:58.348465 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f2c061-5729-47e2-9ebf-094e1d1e06b0 None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:11:58.348593 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f2c061-5729-47e2-9ebf-094e1d1e06b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:11:58.413380 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.auth.core [None req-43f2c061-5729-47e2-9ebf-094e1d1e06b0 None None] MFA Rules not processed for user `ae863915635746d1ac19970949de4722`. Rule list: `[]` (Enabled: `True`). {{(pid=81765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:11:58.415121 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-43f2c061-5729-47e2-9ebf-094e1d1e06b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:11:58.514439 dv-cinder-862365-1-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 521/1052] 10.222.0.23 () {58 vars in 1024 bytes} [Fri Oct 28 19:11:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 19:11:58.802885 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3542b5-b396-4c9f-9b92-0910358324b6 None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:11:58.804989 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-af3542b5-b396-4c9f-9b92-0910358324b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:11:58.895335 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:11:58.958994 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3542b5-b396-4c9f-9b92-0910358324b6 None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:11:59.080380 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066e253f-a355-4ab6-a033-efa648c36524 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8877180cd9844dad8b0980de34769ec8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b705897907f042c0818a931052438e1e', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:11:59.080985 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066e253f-a355-4ab6-a033-efa648c36524 service nova] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:11:59.081258 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066e253f-a355-4ab6-a033-efa648c36524 service nova] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:11:59.081552 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066e253f-a355-4ab6-a033-efa648c36524 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:11:59.083131 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-066e253f-a355-4ab6-a033-efa648c36524 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:11:59.136824 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:11:59.177238 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066e253f-a355-4ab6-a033-efa648c36524 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:11:59.178920 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066e253f-a355-4ab6-a033-efa648c36524 service nova] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:11:59.197873 dv-cinder-862365-1-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 532/1053] 10.222.0.23 () {60 vars in 1365 bytes} [Fri Oct 28 19:11:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 395 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 19:12:01.660899 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f98a2e8-f993-41fe-99c7-1c5dbe0623a5 None None] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:12:01.661480 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f98a2e8-f993-41fe-99c7-1c5dbe0623a5 None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:12:01.661480 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f98a2e8-f993-41fe-99c7-1c5dbe0623a5 None None] PATH_INFO: `/` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:12:01.663075 dv-cinder-862365-1-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 522/1054] 10.222.0.23 () {54 vars in 927 bytes} [Fri Oct 28 19:12:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 19:12:01.668154 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0928d445-8b1b-486f-b985-0ba794c9370e None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:12:01.668549 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0928d445-8b1b-486f-b985-0ba794c9370e None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:12:01.668705 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0928d445-8b1b-486f-b985-0ba794c9370e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:12:01.735662 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-0928d445-8b1b-486f-b985-0ba794c9370e None None] MFA Rules not processed for user `ae863915635746d1ac19970949de4722`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:12:01.736865 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-0928d445-8b1b-486f-b985-0ba794c9370e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:12:01.838922 dv-cinder-862365-1-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 533/1055] 10.222.0.23 () {58 vars in 1024 bytes} [Fri Oct 28 19:12:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 19:12:02.137817 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f98a2e8-f993-41fe-99c7-1c5dbe0623a5 None None] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:12:02.139323 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-3f98a2e8-f993-41fe-99c7-1c5dbe0623a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:12:02.178463 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:12:02.292235 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f98a2e8-f993-41fe-99c7-1c5dbe0623a5 None None] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:12:02.410706 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:12:02.416604 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b18d7e-1efa-48db-a8b5-5bcb13d967fa service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8877180cd9844dad8b0980de34769ec8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b705897907f042c0818a931052438e1e', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:12:02.421366 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b18d7e-1efa-48db-a8b5-5bcb13d967fa service nova] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:12:02.421366 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b18d7e-1efa-48db-a8b5-5bcb13d967fa service nova] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:12:02.421366 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b18d7e-1efa-48db-a8b5-5bcb13d967fa service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:12:02.421366 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-71b18d7e-1efa-48db-a8b5-5bcb13d967fa service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:12:02.514713 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b18d7e-1efa-48db-a8b5-5bcb13d967fa service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:12:02.516305 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b18d7e-1efa-48db-a8b5-5bcb13d967fa service nova] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:12:02.536329 dv-cinder-862365-1-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 523/1056] 10.222.0.23 () {60 vars in 1365 bytes} [Fri Oct 28 19:12:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 399 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 19:12:04.901466 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb09ddd-7416-40c5-812b-61be3eeae70b None None] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:12:04.901943 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb09ddd-7416-40c5-812b-61be3eeae70b None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:12:04.902140 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb09ddd-7416-40c5-812b-61be3eeae70b None None] PATH_INFO: `/` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:12:04.903783 dv-cinder-862365-1-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 534/1057] 10.222.0.23 () {54 vars in 927 bytes} [Fri Oct 28 19:12:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 19:12:04.909017 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d72d44e-8ee4-41cb-b960-214bb37322e2 None None] REQUEST_METHOD: `POST` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:12:04.909443 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d72d44e-8ee4-41cb-b960-214bb37322e2 None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:12:04.909673 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d72d44e-8ee4-41cb-b960-214bb37322e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:12:04.984800 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.auth.core [None req-0d72d44e-8ee4-41cb-b960-214bb37322e2 None None] MFA Rules not processed for user `ae863915635746d1ac19970949de4722`. Rule list: `[]` (Enabled: `True`). {{(pid=81765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:12:04.985906 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-0d72d44e-8ee4-41cb-b960-214bb37322e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:12:05.057081 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:12:05.092903 dv-cinder-862365-1-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 524/1058] 10.222.0.23 () {58 vars in 1024 bytes} [Fri Oct 28 19:12:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 19:12:05.448463 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb09ddd-7416-40c5-812b-61be3eeae70b None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:12:05.450109 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-edb09ddd-7416-40c5-812b-61be3eeae70b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:12:05.480508 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:12:05.616632 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb09ddd-7416-40c5-812b-61be3eeae70b None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:12:05.715611 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:12:05.731888 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a175cac7-24dd-494d-b7e5-4e5e8793e662 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8877180cd9844dad8b0980de34769ec8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b705897907f042c0818a931052438e1e', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:12:05.732502 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a175cac7-24dd-494d-b7e5-4e5e8793e662 service nova] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:12:05.732783 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a175cac7-24dd-494d-b7e5-4e5e8793e662 service nova] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:12:05.733049 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a175cac7-24dd-494d-b7e5-4e5e8793e662 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:12:05.734776 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-a175cac7-24dd-494d-b7e5-4e5e8793e662 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:12:05.834961 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a175cac7-24dd-494d-b7e5-4e5e8793e662 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:12:05.837222 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a175cac7-24dd-494d-b7e5-4e5e8793e662 service nova] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:12:05.857130 dv-cinder-862365-1-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 535/1059] 10.222.0.23 () {60 vars in 1365 bytes} [Fri Oct 28 19:12:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 409 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 19:12:08.213212 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e9a7eb-73b4-4490-a0d8-541aa2abbc8e None None] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:12:08.213818 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e9a7eb-73b4-4490-a0d8-541aa2abbc8e None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:12:08.213917 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e9a7eb-73b4-4490-a0d8-541aa2abbc8e None None] PATH_INFO: `/` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:12:08.215814 dv-cinder-862365-1-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 525/1060] 10.222.0.23 () {54 vars in 927 bytes} [Fri Oct 28 19:12:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 19:12:08.221474 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d3f8d3-c3f5-45ab-957c-11b485256815 None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:12:08.221982 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d3f8d3-c3f5-45ab-957c-11b485256815 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:12:08.222091 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d3f8d3-c3f5-45ab-957c-11b485256815 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:12:08.296021 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-89d3f8d3-c3f5-45ab-957c-11b485256815 None None] MFA Rules not processed for user `ae863915635746d1ac19970949de4722`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:12:08.297625 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-89d3f8d3-c3f5-45ab-957c-11b485256815 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:12:08.365568 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:12:08.406933 dv-cinder-862365-1-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 536/1061] 10.222.0.23 () {58 vars in 1024 bytes} [Fri Oct 28 19:12:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 19:12:08.696081 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e9a7eb-73b4-4490-a0d8-541aa2abbc8e None None] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:12:08.697638 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-33e9a7eb-73b4-4490-a0d8-541aa2abbc8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:12:08.853278 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e9a7eb-73b4-4490-a0d8-541aa2abbc8e None None] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:12:08.919377 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:12:08.996363 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237f58b2-f75d-4e6d-bcdc-ecca723824d0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8877180cd9844dad8b0980de34769ec8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b705897907f042c0818a931052438e1e', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:12:08.997130 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237f58b2-f75d-4e6d-bcdc-ecca723824d0 service nova] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:12:08.997552 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237f58b2-f75d-4e6d-bcdc-ecca723824d0 service nova] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:12:08.997893 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237f58b2-f75d-4e6d-bcdc-ecca723824d0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:12:08.999926 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-237f58b2-f75d-4e6d-bcdc-ecca723824d0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:12:09.095827 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-237f58b2-f75d-4e6d-bcdc-ecca723824d0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:12:09.097472 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-237f58b2-f75d-4e6d-bcdc-ecca723824d0 service nova] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:12:09.117070 dv-cinder-862365-1-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 526/1062] 10.222.0.23 () {60 vars in 1365 bytes} [Fri Oct 28 19:12:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 422 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 19:12:11.571959 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e16acf5-92be-40ab-9445-6716b929f646 None None] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:12:11.572504 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e16acf5-92be-40ab-9445-6716b929f646 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:12:11.572504 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e16acf5-92be-40ab-9445-6716b929f646 None None] PATH_INFO: `/` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:12:11.573890 dv-cinder-862365-1-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 537/1063] 10.222.0.23 () {54 vars in 927 bytes} [Fri Oct 28 19:12:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 19:12:11.579118 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79406ea-7961-4533-baf3-78687d267299 None None] REQUEST_METHOD: `POST` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:12:11.579533 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79406ea-7961-4533-baf3-78687d267299 None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:12:11.579651 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79406ea-7961-4533-baf3-78687d267299 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:12:11.646427 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.auth.core [None req-a79406ea-7961-4533-baf3-78687d267299 None None] MFA Rules not processed for user `ae863915635746d1ac19970949de4722`. Rule list: `[]` (Enabled: `True`). {{(pid=81765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:12:11.647631 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-a79406ea-7961-4533-baf3-78687d267299 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:12:11.656647 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:12:11.746409 dv-cinder-862365-1-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 527/1064] 10.222.0.23 () {58 vars in 1024 bytes} [Fri Oct 28 19:12:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 19:12:12.038215 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e16acf5-92be-40ab-9445-6716b929f646 None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:12:12.040398 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-0e16acf5-92be-40ab-9445-6716b929f646 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:12:12.189745 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e16acf5-92be-40ab-9445-6716b929f646 None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:12:12.240381 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:12:12.307940 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6adcb45-5af2-4ccb-a2d7-807b6b46ec5f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8877180cd9844dad8b0980de34769ec8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b705897907f042c0818a931052438e1e', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:12:12.308544 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6adcb45-5af2-4ccb-a2d7-807b6b46ec5f service nova] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:12:12.308821 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6adcb45-5af2-4ccb-a2d7-807b6b46ec5f service nova] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:12:12.309092 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6adcb45-5af2-4ccb-a2d7-807b6b46ec5f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:12:12.310709 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-a6adcb45-5af2-4ccb-a2d7-807b6b46ec5f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:12:12.402813 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6adcb45-5af2-4ccb-a2d7-807b6b46ec5f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:12:12.404396 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6adcb45-5af2-4ccb-a2d7-807b6b46ec5f service nova] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:12:12.422277 dv-cinder-862365-1-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 538/1065] 10.222.0.23 () {60 vars in 1365 bytes} [Fri Oct 28 19:12:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 385 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 19:12:12.774182 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f16623-52b9-4037-87e4-a51bbc0fd24d None None] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:12:12.774700 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f16623-52b9-4037-87e4-a51bbc0fd24d None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:12:12.774700 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f16623-52b9-4037-87e4-a51bbc0fd24d None None] PATH_INFO: `/` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:12:12.776220 dv-cinder-862365-1-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 528/1066] 10.222.0.23 () {54 vars in 927 bytes} [Fri Oct 28 19:12:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 19:12:12.781768 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed51c960-3bc3-4b44-b5db-fa061cac37dd None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:12:12.782190 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed51c960-3bc3-4b44-b5db-fa061cac37dd None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:12:12.782326 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed51c960-3bc3-4b44-b5db-fa061cac37dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:12:12.851176 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:12:12.853733 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-ed51c960-3bc3-4b44-b5db-fa061cac37dd None None] MFA Rules not processed for user `ae863915635746d1ac19970949de4722`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:12:12.854929 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-ed51c960-3bc3-4b44-b5db-fa061cac37dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:12:12.961119 dv-cinder-862365-1-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 539/1067] 10.222.0.23 () {58 vars in 1024 bytes} [Fri Oct 28 19:12:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 19:12:13.267973 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c6d472-aad7-49c8-864d-d7c19c87062d None None] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:12:13.268259 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c6d472-aad7-49c8-864d-d7c19c87062d None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:12:13.268532 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c6d472-aad7-49c8-864d-d7c19c87062d None None] PATH_INFO: `/` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:12:13.269960 dv-cinder-862365-1-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 529/1068] 10.222.0.23 () {54 vars in 962 bytes} [Fri Oct 28 19:12:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 19:12:13.275403 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29970790-f9d4-4814-9de2-5e5e4343dc88 None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:12:13.275759 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29970790-f9d4-4814-9de2-5e5e4343dc88 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:12:13.276106 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29970790-f9d4-4814-9de2-5e5e4343dc88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:12:13.355507 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-29970790-f9d4-4814-9de2-5e5e4343dc88 None None] MFA Rules not processed for user `e441de25d614487c80452642c67df04a`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:12:13.356714 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-29970790-f9d4-4814-9de2-5e5e4343dc88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:12:13.425777 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:12:13.432088 dv-cinder-862365-1-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 540/1069] 10.222.0.23 () {58 vars in 1059 bytes} [Fri Oct 28 19:12:13 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 19:12:13.440131 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c6d472-aad7-49c8-864d-d7c19c87062d None None] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:12:13.441750 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-11c6d472-aad7-49c8-864d-d7c19c87062d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:12:13.557217 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c6d472-aad7-49c8-864d-d7c19c87062d None None] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:12:13.596773 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:12:13.633895 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7124ddb5-24a9-4be2-b23a-afa727c42064 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e441de25d614487c80452642c67df04a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b705897907f042c0818a931052438e1e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:12:13.634496 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7124ddb5-24a9-4be2-b23a-afa727c42064 service glance] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:12:13.634777 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7124ddb5-24a9-4be2-b23a-afa727c42064 service glance] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:12:13.635045 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7124ddb5-24a9-4be2-b23a-afa727c42064 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:12:13.636639 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-7124ddb5-24a9-4be2-b23a-afa727c42064 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:12:13.748298 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7124ddb5-24a9-4be2-b23a-afa727c42064 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:12:13.749768 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7124ddb5-24a9-4be2-b23a-afa727c42064 service glance] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:12:13.769157 dv-cinder-862365-1-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 530/1070] 10.222.0.23 () {60 vars in 1365 bytes} [Fri Oct 28 19:12:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 19:12:14.672428 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b8df7f-0e8f-4d91-a79f-ea4cdfddd6c3 None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:12:14.672931 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b8df7f-0e8f-4d91-a79f-ea4cdfddd6c3 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:12:14.673049 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b8df7f-0e8f-4d91-a79f-ea4cdfddd6c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:12:14.735715 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eacf972-d40a-4b44-85ee-feae2b688507 None None] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:12:14.736149 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eacf972-d40a-4b44-85ee-feae2b688507 None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:12:14.736267 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eacf972-d40a-4b44-85ee-feae2b688507 None None] PATH_INFO: `/` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:12:14.737727 dv-cinder-862365-1-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 531/1071] 10.222.0.23 () {54 vars in 927 bytes} [Fri Oct 28 19:12:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 28 19:12:14.742235 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-78b8df7f-0e8f-4d91-a79f-ea4cdfddd6c3 None None] MFA Rules not processed for user `820bee57d7dc4c5a962107e97f050835`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:12:14.742861 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2860d816-e20b-45f7-bf8a-28afdd4851d2 None None] REQUEST_METHOD: `POST` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:12:14.743148 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2860d816-e20b-45f7-bf8a-28afdd4851d2 None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:12:14.743425 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2860d816-e20b-45f7-bf8a-28afdd4851d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:12:14.743518 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-78b8df7f-0e8f-4d91-a79f-ea4cdfddd6c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:12:14.811977 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.auth.core [None req-2860d816-e20b-45f7-bf8a-28afdd4851d2 None None] MFA Rules not processed for user `ae863915635746d1ac19970949de4722`. Rule list: `[]` (Enabled: `True`). {{(pid=81765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:12:14.813090 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-2860d816-e20b-45f7-bf8a-28afdd4851d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:12:14.834654 dv-cinder-862365-1-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 541/1072] 10.222.0.23 () {58 vars in 1009 bytes} [Fri Oct 28 19:12:14 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 19:12:14.836779 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:12:14.885230 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5e0f85-1ef2-4274-9e81-e8f7beb3648e None None] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:12:14.885552 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5e0f85-1ef2-4274-9e81-e8f7beb3648e None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:12:14.885826 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5e0f85-1ef2-4274-9e81-e8f7beb3648e None None] PATH_INFO: `/` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:12:14.887205 dv-cinder-862365-1-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 542/1073] 10.222.0.23 () {54 vars in 943 bytes} [Fri Oct 28 19:12:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 28 19:12:14.893570 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d26e711-6d5c-4f61-9cbc-7041df8ae7e9 None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:12:14.893929 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d26e711-6d5c-4f61-9cbc-7041df8ae7e9 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:12:14.894241 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d26e711-6d5c-4f61-9cbc-7041df8ae7e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:12:14.921523 dv-cinder-862365-1-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 532/1074] 10.222.0.23 () {58 vars in 1024 bytes} [Fri Oct 28 19:12:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 19:12:14.979340 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-2d26e711-6d5c-4f61-9cbc-7041df8ae7e9 None None] MFA Rules not processed for user `ddd2863f2113472cb20577990b5c55d7`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:12:14.980741 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-2d26e711-6d5c-4f61-9cbc-7041df8ae7e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:12:15.015817 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:12:15.107297 dv-cinder-862365-1-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 543/1075] 10.222.0.23 () {58 vars in 1040 bytes} [Fri Oct 28 19:12:14 2022] POST /identity/v3/auth/tokens => generated 3304 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 19:12:15.107731 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2860d816-e20b-45f7-bf8a-28afdd4851d2 None None] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:12:15.109369 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-2860d816-e20b-45f7-bf8a-28afdd4851d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:12:15.216580 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2860d816-e20b-45f7-bf8a-28afdd4851d2 None None] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:12:15.219358 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d26e711-6d5c-4f61-9cbc-7041df8ae7e9 None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:12:15.220861 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-2d26e711-6d5c-4f61-9cbc-7041df8ae7e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:12:15.266152 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:12:15.317381 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d26e711-6d5c-4f61-9cbc-7041df8ae7e9 None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:12:15.323117 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9cab945-bb87-4115-9e30-a494cccc0df1 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddd2863f2113472cb20577990b5c55d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b705897907f042c0818a931052438e1e', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:12:15.323724 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cab945-bb87-4115-9e30-a494cccc0df1 service swift] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:12:15.324002 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cab945-bb87-4115-9e30-a494cccc0df1 service swift] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:12:15.324271 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cab945-bb87-4115-9e30-a494cccc0df1 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:12:15.325936 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-b9cab945-bb87-4115-9e30-a494cccc0df1 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:12:15.367526 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:12:15.416467 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9cab945-bb87-4115-9e30-a494cccc0df1 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:12:15.418126 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9cab945-bb87-4115-9e30-a494cccc0df1 service swift] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:12:15.426121 dv-cinder-862365-1-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 533/1076] 10.222.0.23 () {60 vars in 1384 bytes} [Fri Oct 28 19:12:15 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 28 19:12:15.433593 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9bc292-9a71-4031-95e5-c2c3f7a7bb99 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8877180cd9844dad8b0980de34769ec8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b705897907f042c0818a931052438e1e', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:12:15.434208 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9bc292-9a71-4031-95e5-c2c3f7a7bb99 service nova] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:12:15.434486 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9bc292-9a71-4031-95e5-c2c3f7a7bb99 service nova] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:12:15.435359 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9bc292-9a71-4031-95e5-c2c3f7a7bb99 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:12:15.436344 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-9e9bc292-9a71-4031-95e5-c2c3f7a7bb99 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:12:15.527015 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9bc292-9a71-4031-95e5-c2c3f7a7bb99 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:12:15.528596 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9bc292-9a71-4031-95e5-c2c3f7a7bb99 service nova] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:12:15.546134 dv-cinder-862365-1-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 544/1077] 10.222.0.23 () {60 vars in 1365 bytes} [Fri Oct 28 19:12:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 28 19:12:17.908532 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608db189-c6ef-49c7-9eac-c4af11d5ef44 None None] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:12:17.909102 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608db189-c6ef-49c7-9eac-c4af11d5ef44 None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:12:17.909102 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608db189-c6ef-49c7-9eac-c4af11d5ef44 None None] PATH_INFO: `/` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:12:17.915233 dv-cinder-862365-1-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 534/1078] 10.222.0.23 () {54 vars in 927 bytes} [Fri Oct 28 19:12:17 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 19:12:17.916478 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a9ab61-5eca-4d5d-9489-6a8d620cbd2a None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:12:17.917152 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a9ab61-5eca-4d5d-9489-6a8d620cbd2a None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:12:17.917152 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a9ab61-5eca-4d5d-9489-6a8d620cbd2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:12:17.992762 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-18a9ab61-5eca-4d5d-9489-6a8d620cbd2a None None] MFA Rules not processed for user `ae863915635746d1ac19970949de4722`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:12:17.994001 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-18a9ab61-5eca-4d5d-9489-6a8d620cbd2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:12:17.996954 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:12:18.123090 dv-cinder-862365-1-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 545/1079] 10.222.0.23 () {58 vars in 1024 bytes} [Fri Oct 28 19:12:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 19:12:18.422094 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608db189-c6ef-49c7-9eac-c4af11d5ef44 None None] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:12:18.424029 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-608db189-c6ef-49c7-9eac-c4af11d5ef44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:12:18.511503 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:12:18.593333 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608db189-c6ef-49c7-9eac-c4af11d5ef44 None None] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:12:18.729492 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49d4095-1ffb-483f-94f4-e03a5db747d7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8877180cd9844dad8b0980de34769ec8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b705897907f042c0818a931052438e1e', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:12:18.730257 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49d4095-1ffb-483f-94f4-e03a5db747d7 service nova] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:12:18.730621 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49d4095-1ffb-483f-94f4-e03a5db747d7 service nova] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:12:18.730968 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49d4095-1ffb-483f-94f4-e03a5db747d7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:12:18.732984 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-f49d4095-1ffb-483f-94f4-e03a5db747d7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:12:18.783197 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:12:18.855352 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49d4095-1ffb-483f-94f4-e03a5db747d7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:12:18.857270 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49d4095-1ffb-483f-94f4-e03a5db747d7 service nova] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:12:18.878552 dv-cinder-862365-1-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 535/1080] 10.222.0.23 () {60 vars in 1365 bytes} [Fri Oct 28 19:12:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 457 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 19:12:21.236977 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd53fb88-2918-436c-a538-e70b1fbb498b None None] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:12:21.237565 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd53fb88-2918-436c-a538-e70b1fbb498b None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:12:21.237565 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd53fb88-2918-436c-a538-e70b1fbb498b None None] PATH_INFO: `/` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:12:21.241933 dv-cinder-862365-1-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 546/1081] 10.222.0.23 () {54 vars in 927 bytes} [Fri Oct 28 19:12:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 19:12:21.244821 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7f0826-405b-4bf2-8fe4-9a9f1989059d None None] REQUEST_METHOD: `POST` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:12:21.245234 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7f0826-405b-4bf2-8fe4-9a9f1989059d None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:12:21.245430 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7f0826-405b-4bf2-8fe4-9a9f1989059d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:12:21.322544 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.auth.core [None req-6b7f0826-405b-4bf2-8fe4-9a9f1989059d None None] MFA Rules not processed for user `ae863915635746d1ac19970949de4722`. Rule list: `[]` (Enabled: `True`). {{(pid=81765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:12:21.324081 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-6b7f0826-405b-4bf2-8fe4-9a9f1989059d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:12:21.439023 dv-cinder-862365-1-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 536/1082] 10.222.0.23 () {58 vars in 1024 bytes} [Fri Oct 28 19:12:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 19:12:21.731081 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd53fb88-2918-436c-a538-e70b1fbb498b None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:12:21.732624 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-fd53fb88-2918-436c-a538-e70b1fbb498b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:12:21.896552 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:12:21.909399 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd53fb88-2918-436c-a538-e70b1fbb498b None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:12:22.030509 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c41700-6f92-478f-a334-aad0f8ee83fc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8877180cd9844dad8b0980de34769ec8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b705897907f042c0818a931052438e1e', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:12:22.031126 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c41700-6f92-478f-a334-aad0f8ee83fc service nova] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:12:22.031406 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c41700-6f92-478f-a334-aad0f8ee83fc service nova] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:12:22.031682 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c41700-6f92-478f-a334-aad0f8ee83fc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:12:22.033297 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-19c41700-6f92-478f-a334-aad0f8ee83fc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:12:22.135235 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c41700-6f92-478f-a334-aad0f8ee83fc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:12:22.136881 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c41700-6f92-478f-a334-aad0f8ee83fc service nova] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:12:22.146861 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:12:22.158399 dv-cinder-862365-1-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 547/1083] 10.222.0.23 () {60 vars in 1365 bytes} [Fri Oct 28 19:12:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 428 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 19:12:24.514993 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e8b2d9-e971-499c-b351-4e19360ecd1e None None] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:12:24.515634 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e8b2d9-e971-499c-b351-4e19360ecd1e None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:12:24.515634 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e8b2d9-e971-499c-b351-4e19360ecd1e None None] PATH_INFO: `/` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:12:24.517412 dv-cinder-862365-1-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 537/1084] 10.222.0.23 () {54 vars in 927 bytes} [Fri Oct 28 19:12:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 19:12:24.523217 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4542ae5-4729-4f34-ad62-b49fbf391f9f None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:12:24.523643 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4542ae5-4729-4f34-ad62-b49fbf391f9f None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:12:24.523954 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4542ae5-4729-4f34-ad62-b49fbf391f9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:12:24.598974 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-f4542ae5-4729-4f34-ad62-b49fbf391f9f None None] MFA Rules not processed for user `ae863915635746d1ac19970949de4722`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:12:24.600572 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-f4542ae5-4729-4f34-ad62-b49fbf391f9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:12:24.705369 dv-cinder-862365-1-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 548/1085] 10.222.0.23 () {58 vars in 1024 bytes} [Fri Oct 28 19:12:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 19:12:25.001848 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e8b2d9-e971-499c-b351-4e19360ecd1e None None] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:12:25.003558 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-64e8b2d9-e971-499c-b351-4e19360ecd1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:12:25.025279 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:12:25.168045 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e8b2d9-e971-499c-b351-4e19360ecd1e None None] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:12:25.274022 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:12:25.298745 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f61c996-12b3-4120-b5fb-178a3bbc953f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8877180cd9844dad8b0980de34769ec8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b705897907f042c0818a931052438e1e', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:12:25.299508 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f61c996-12b3-4120-b5fb-178a3bbc953f service nova] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:12:25.299746 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f61c996-12b3-4120-b5fb-178a3bbc953f service nova] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:12:25.300024 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f61c996-12b3-4120-b5fb-178a3bbc953f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:12:25.302582 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-2f61c996-12b3-4120-b5fb-178a3bbc953f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:12:25.401755 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f61c996-12b3-4120-b5fb-178a3bbc953f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:12:25.403860 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f61c996-12b3-4120-b5fb-178a3bbc953f service nova] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:12:25.426122 dv-cinder-862365-1-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 538/1086] 10.222.0.23 () {60 vars in 1365 bytes} [Fri Oct 28 19:12:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 425 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 19:12:34.703786 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=68 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:12:35.420286 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=54 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:12:40.039385 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ae6a71-b8d0-4b46-9b68-4584d35c3f30 None None] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:12:40.039948 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ae6a71-b8d0-4b46-9b68-4584d35c3f30 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:12:40.039948 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ae6a71-b8d0-4b46-9b68-4584d35c3f30 None None] PATH_INFO: `/` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:12:40.041251 dv-cinder-862365-1-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 549/1087] 10.222.0.23 () {54 vars in 918 bytes} [Fri Oct 28 19:12:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 19:12:40.046339 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e342a5-4d12-4a0d-937e-fe6a6d0c5687 None None] REQUEST_METHOD: `POST` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:12:40.046779 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e342a5-4d12-4a0d-937e-fe6a6d0c5687 None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:12:40.046875 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e342a5-4d12-4a0d-937e-fe6a6d0c5687 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:12:40.122631 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.auth.core [None req-94e342a5-4d12-4a0d-937e-fe6a6d0c5687 None None] MFA Rules not processed for user `c3308c9156d44c5599514ffaf708d4b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:12:40.123768 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-94e342a5-4d12-4a0d-937e-fe6a6d0c5687 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:12:40.231356 dv-cinder-862365-1-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 539/1088] 10.222.0.23 () {58 vars in 1015 bytes} [Fri Oct 28 19:12:40 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 19:12:40.246157 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8975e842-4a99-4843-8489-2e5eb7c4e248 None None] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:12:40.246449 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8975e842-4a99-4843-8489-2e5eb7c4e248 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:12:40.246726 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8975e842-4a99-4843-8489-2e5eb7c4e248 None None] PATH_INFO: `/` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:12:40.248044 dv-cinder-862365-1-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 550/1089] 10.222.0.23 () {54 vars in 918 bytes} [Fri Oct 28 19:12:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 19:12:40.252716 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f7667f-b760-46db-ab00-8582c2f51a3c None None] REQUEST_METHOD: `POST` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:12:40.253007 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f7667f-b760-46db-ab00-8582c2f51a3c None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:12:40.253285 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f7667f-b760-46db-ab00-8582c2f51a3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:12:40.325057 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:12:40.328018 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.auth.core [None req-43f7667f-b760-46db-ab00-8582c2f51a3c None None] MFA Rules not processed for user `8877180cd9844dad8b0980de34769ec8`. Rule list: `[]` (Enabled: `True`). {{(pid=81765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:12:40.329296 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-43f7667f-b760-46db-ab00-8582c2f51a3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:12:40.442946 dv-cinder-862365-1-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 540/1090] 10.222.0.23 () {58 vars in 1015 bytes} [Fri Oct 28 19:12:40 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 19:12:43.020235 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36331d16-4e2b-4b68-9a60-bad13470fdf7 None None] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:12:43.020775 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36331d16-4e2b-4b68-9a60-bad13470fdf7 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:12:43.020775 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36331d16-4e2b-4b68-9a60-bad13470fdf7 None None] PATH_INFO: `/` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:12:43.022121 dv-cinder-862365-1-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 551/1091] 127.0.0.1 () {54 vars in 917 bytes} [Fri Oct 28 19:12:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 19:12:43.028076 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19115dd1-97a0-49f4-965d-309f1d3d3c6d None None] REQUEST_METHOD: `POST` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:12:43.028498 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19115dd1-97a0-49f4-965d-309f1d3d3c6d None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:12:43.028658 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19115dd1-97a0-49f4-965d-309f1d3d3c6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:12:43.095922 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.auth.core [None req-19115dd1-97a0-49f4-965d-309f1d3d3c6d None None] MFA Rules not processed for user `ae863915635746d1ac19970949de4722`. Rule list: `[]` (Enabled: `True`). {{(pid=81765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:12:43.097125 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-19115dd1-97a0-49f4-965d-309f1d3d3c6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:12:43.152030 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:12:43.195615 dv-cinder-862365-1-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 541/1092] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Oct 28 19:12:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 19:12:43.494681 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36331d16-4e2b-4b68-9a60-bad13470fdf7 None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:12:43.494681 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-36331d16-4e2b-4b68-9a60-bad13470fdf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:12:43.634296 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36331d16-4e2b-4b68-9a60-bad13470fdf7 None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:12:43.705691 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:12:43.745538 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c6b563-7bef-4ea3-96b8-59537033949f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8877180cd9844dad8b0980de34769ec8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b705897907f042c0818a931052438e1e', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:12:43.746068 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c6b563-7bef-4ea3-96b8-59537033949f service nova] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:12:43.746342 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c6b563-7bef-4ea3-96b8-59537033949f service nova] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:12:43.746610 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c6b563-7bef-4ea3-96b8-59537033949f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:12:43.748187 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-07c6b563-7bef-4ea3-96b8-59537033949f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:12:43.836039 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c6b563-7bef-4ea3-96b8-59537033949f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:12:43.837641 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c6b563-7bef-4ea3-96b8-59537033949f service nova] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:12:43.855410 dv-cinder-862365-1-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 552/1093] 10.222.0.23 () {60 vars in 1365 bytes} [Fri Oct 28 19:12:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 19:12:44.979213 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff610a1c-03a6-40e9-9ccc-b75f20540d55 None None] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:12:44.979797 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff610a1c-03a6-40e9-9ccc-b75f20540d55 None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:12:44.979797 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff610a1c-03a6-40e9-9ccc-b75f20540d55 None None] PATH_INFO: `/` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:12:44.981138 dv-cinder-862365-1-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 542/1094] 127.0.0.1 () {54 vars in 901 bytes} [Fri Oct 28 19:12:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 19:12:44.986279 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c799fc-a731-4ade-92fc-7075cddee04d None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:12:44.986727 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c799fc-a731-4ade-92fc-7075cddee04d None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:12:44.986852 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c799fc-a731-4ade-92fc-7075cddee04d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:12:45.061125 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-72c799fc-a731-4ade-92fc-7075cddee04d None None] MFA Rules not processed for user `ae863915635746d1ac19970949de4722`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:12:45.062265 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-72c799fc-a731-4ade-92fc-7075cddee04d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:12:45.088769 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:12:45.157052 dv-cinder-862365-1-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 553/1095] 127.0.0.1 () {58 vars in 998 bytes} [Fri Oct 28 19:12:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 19:12:45.330215 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff610a1c-03a6-40e9-9ccc-b75f20540d55 None None] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:12:45.331639 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-ff610a1c-03a6-40e9-9ccc-b75f20540d55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:12:45.475057 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff610a1c-03a6-40e9-9ccc-b75f20540d55 None None] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:12:45.515540 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:12:45.587124 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f89d535-49a2-42f8-9a3b-b21b83321f05 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8877180cd9844dad8b0980de34769ec8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b705897907f042c0818a931052438e1e', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:12:45.587655 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f89d535-49a2-42f8-9a3b-b21b83321f05 service nova] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:12:45.587940 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f89d535-49a2-42f8-9a3b-b21b83321f05 service nova] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:12:45.588212 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f89d535-49a2-42f8-9a3b-b21b83321f05 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:12:45.589838 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-9f89d535-49a2-42f8-9a3b-b21b83321f05 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:12:45.677788 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f89d535-49a2-42f8-9a3b-b21b83321f05 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:12:45.679372 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f89d535-49a2-42f8-9a3b-b21b83321f05 service nova] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:12:45.697655 dv-cinder-862365-1-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 543/1096] 10.222.0.23 () {60 vars in 1365 bytes} [Fri Oct 28 19:12:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 19:12:46.824265 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932bca95-3330-4166-a85f-6a44cf1e4918 None None] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:12:46.824828 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932bca95-3330-4166-a85f-6a44cf1e4918 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:12:46.824828 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932bca95-3330-4166-a85f-6a44cf1e4918 None None] PATH_INFO: `/` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:12:46.826188 dv-cinder-862365-1-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 554/1097] 127.0.0.1 () {54 vars in 901 bytes} [Fri Oct 28 19:12:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 19:12:46.831205 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25789b1-8ce8-48b9-9d27-963565927660 None None] REQUEST_METHOD: `POST` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:12:46.831660 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25789b1-8ce8-48b9-9d27-963565927660 None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:12:46.831855 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25789b1-8ce8-48b9-9d27-963565927660 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:12:46.889019 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:12:46.910979 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.auth.core [None req-a25789b1-8ce8-48b9-9d27-963565927660 None None] MFA Rules not processed for user `ae863915635746d1ac19970949de4722`. Rule list: `[]` (Enabled: `True`). {{(pid=81765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:12:46.912243 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-a25789b1-8ce8-48b9-9d27-963565927660 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:12:47.008684 dv-cinder-862365-1-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 544/1098] 127.0.0.1 () {58 vars in 998 bytes} [Fri Oct 28 19:12:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 19:12:47.161941 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932bca95-3330-4166-a85f-6a44cf1e4918 None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:12:47.163558 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-932bca95-3330-4166-a85f-6a44cf1e4918 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:12:47.309825 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932bca95-3330-4166-a85f-6a44cf1e4918 None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:12:47.322214 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:12:47.421306 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5190e6-0dcb-4b75-9339-56c617343b93 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8877180cd9844dad8b0980de34769ec8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b705897907f042c0818a931052438e1e', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:12:47.421930 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5190e6-0dcb-4b75-9339-56c617343b93 service nova] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:12:47.422210 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5190e6-0dcb-4b75-9339-56c617343b93 service nova] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:12:47.422481 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5190e6-0dcb-4b75-9339-56c617343b93 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:12:47.424073 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-fc5190e6-0dcb-4b75-9339-56c617343b93 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:12:47.512068 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5190e6-0dcb-4b75-9339-56c617343b93 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:12:47.513666 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5190e6-0dcb-4b75-9339-56c617343b93 service nova] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:12:47.531596 dv-cinder-862365-1-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 555/1099] 10.222.0.23 () {60 vars in 1365 bytes} [Fri Oct 28 19:12:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 19:12:48.617085 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bd018a-2fc2-4334-be22-2bd5d341f769 None None] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:12:48.617788 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bd018a-2fc2-4334-be22-2bd5d341f769 None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:12:48.617788 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bd018a-2fc2-4334-be22-2bd5d341f769 None None] PATH_INFO: `/` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:12:48.619088 dv-cinder-862365-1-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 545/1100] 127.0.0.1 () {54 vars in 901 bytes} [Fri Oct 28 19:12:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 19:12:48.623957 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab6054f-8a7f-4820-a035-56d7602629b6 None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:12:48.624403 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab6054f-8a7f-4820-a035-56d7602629b6 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:12:48.624543 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab6054f-8a7f-4820-a035-56d7602629b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:12:48.646291 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:12:48.702648 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-5ab6054f-8a7f-4820-a035-56d7602629b6 None None] MFA Rules not processed for user `ae863915635746d1ac19970949de4722`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:12:48.703905 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-5ab6054f-8a7f-4820-a035-56d7602629b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:12:48.800252 dv-cinder-862365-1-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 556/1101] 127.0.0.1 () {58 vars in 998 bytes} [Fri Oct 28 19:12:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 19:12:48.951066 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71bd018a-2fc2-4334-be22-2bd5d341f769 None None] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:12:48.952786 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-71bd018a-2fc2-4334-be22-2bd5d341f769 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:12:49.064901 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:12:49.100741 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71bd018a-2fc2-4334-be22-2bd5d341f769 None None] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:12:49.214472 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a234fa5c-ee75-4155-9651-651054ee5fa0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8877180cd9844dad8b0980de34769ec8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b705897907f042c0818a931052438e1e', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:12:49.214998 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a234fa5c-ee75-4155-9651-651054ee5fa0 service nova] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:12:49.215279 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a234fa5c-ee75-4155-9651-651054ee5fa0 service nova] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:12:49.215553 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a234fa5c-ee75-4155-9651-651054ee5fa0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:12:49.217143 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-a234fa5c-ee75-4155-9651-651054ee5fa0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:12:49.294275 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:12:49.308142 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a234fa5c-ee75-4155-9651-651054ee5fa0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:12:49.309770 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a234fa5c-ee75-4155-9651-651054ee5fa0 service nova] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:12:49.327961 dv-cinder-862365-1-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 546/1102] 10.222.0.23 () {60 vars in 1365 bytes} [Fri Oct 28 19:12:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 19:12:50.426817 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daeb0ca1-dad0-43be-aae7-a967608ec3d4 None None] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:12:50.427369 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daeb0ca1-dad0-43be-aae7-a967608ec3d4 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:12:50.427369 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daeb0ca1-dad0-43be-aae7-a967608ec3d4 None None] PATH_INFO: `/` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:12:50.429249 dv-cinder-862365-1-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 557/1103] 127.0.0.1 () {54 vars in 901 bytes} [Fri Oct 28 19:12:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 19:12:50.434195 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d3f15d-2371-4acb-96c7-4644b737575e None None] REQUEST_METHOD: `POST` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:12:50.434651 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d3f15d-2371-4acb-96c7-4644b737575e None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:12:50.434755 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d3f15d-2371-4acb-96c7-4644b737575e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:12:50.508552 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.auth.core [None req-31d3f15d-2371-4acb-96c7-4644b737575e None None] MFA Rules not processed for user `ae863915635746d1ac19970949de4722`. Rule list: `[]` (Enabled: `True`). {{(pid=81765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:12:50.509762 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-31d3f15d-2371-4acb-96c7-4644b737575e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:12:50.604510 dv-cinder-862365-1-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 547/1104] 127.0.0.1 () {58 vars in 998 bytes} [Fri Oct 28 19:12:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 19:12:50.760564 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daeb0ca1-dad0-43be-aae7-a967608ec3d4 None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:12:50.762201 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-daeb0ca1-dad0-43be-aae7-a967608ec3d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:12:50.846358 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:12:50.907562 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daeb0ca1-dad0-43be-aae7-a967608ec3d4 None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:12:51.018126 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da95b0e3-32bb-4432-ba62-f430c8e0b166 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8877180cd9844dad8b0980de34769ec8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b705897907f042c0818a931052438e1e', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:12:51.018641 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da95b0e3-32bb-4432-ba62-f430c8e0b166 service nova] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:12:51.018920 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da95b0e3-32bb-4432-ba62-f430c8e0b166 service nova] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:12:51.019191 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da95b0e3-32bb-4432-ba62-f430c8e0b166 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:12:51.020794 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-da95b0e3-32bb-4432-ba62-f430c8e0b166 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:12:51.069796 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:12:51.110944 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da95b0e3-32bb-4432-ba62-f430c8e0b166 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:12:51.112540 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da95b0e3-32bb-4432-ba62-f430c8e0b166 service nova] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:12:51.130505 dv-cinder-862365-1-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 558/1105] 10.222.0.23 () {60 vars in 1365 bytes} [Fri Oct 28 19:12:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 19:12:52.232948 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d52e2b-9a8d-4f6a-a7dd-8a896ffd9f70 None None] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:12:52.233536 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d52e2b-9a8d-4f6a-a7dd-8a896ffd9f70 None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:12:52.233536 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d52e2b-9a8d-4f6a-a7dd-8a896ffd9f70 None None] PATH_INFO: `/` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:12:52.234879 dv-cinder-862365-1-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 548/1106] 127.0.0.1 () {54 vars in 901 bytes} [Fri Oct 28 19:12:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 19:12:52.240687 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f484c735-323c-4daa-a7cc-9b0c57ddb133 None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:12:52.241105 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f484c735-323c-4daa-a7cc-9b0c57ddb133 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:12:52.241266 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f484c735-323c-4daa-a7cc-9b0c57ddb133 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:12:52.316181 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-f484c735-323c-4daa-a7cc-9b0c57ddb133 None None] MFA Rules not processed for user `ae863915635746d1ac19970949de4722`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:12:52.317393 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-f484c735-323c-4daa-a7cc-9b0c57ddb133 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:12:52.410464 dv-cinder-862365-1-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 559/1107] 127.0.0.1 () {58 vars in 998 bytes} [Fri Oct 28 19:12:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 19:12:52.558821 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d52e2b-9a8d-4f6a-a7dd-8a896ffd9f70 None None] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:12:52.560363 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-61d52e2b-9a8d-4f6a-a7dd-8a896ffd9f70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:12:52.609243 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:12:52.708077 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d52e2b-9a8d-4f6a-a7dd-8a896ffd9f70 None None] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:12:52.819792 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1df621-12a5-4c0c-8f81-5dbf1c8814bb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8877180cd9844dad8b0980de34769ec8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b705897907f042c0818a931052438e1e', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:12:52.820375 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1df621-12a5-4c0c-8f81-5dbf1c8814bb service nova] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:12:52.820653 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1df621-12a5-4c0c-8f81-5dbf1c8814bb service nova] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:12:52.820922 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1df621-12a5-4c0c-8f81-5dbf1c8814bb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:12:52.822564 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-eb1df621-12a5-4c0c-8f81-5dbf1c8814bb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:12:52.829310 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:12:52.915577 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1df621-12a5-4c0c-8f81-5dbf1c8814bb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:12:52.917175 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1df621-12a5-4c0c-8f81-5dbf1c8814bb service nova] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:12:52.936397 dv-cinder-862365-1-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 549/1108] 10.222.0.23 () {60 vars in 1365 bytes} [Fri Oct 28 19:12:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 19:12:54.042914 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b01534e-7847-429c-a300-ecaff5704f39 None None] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:12:54.043450 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b01534e-7847-429c-a300-ecaff5704f39 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:12:54.043450 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b01534e-7847-429c-a300-ecaff5704f39 None None] PATH_INFO: `/` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:12:54.044807 dv-cinder-862365-1-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 560/1109] 127.0.0.1 () {54 vars in 901 bytes} [Fri Oct 28 19:12:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 19:12:54.049923 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01cb157-a0ad-438a-be66-6eacd04e943d None None] REQUEST_METHOD: `POST` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:12:54.050314 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01cb157-a0ad-438a-be66-6eacd04e943d None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:12:54.050504 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01cb157-a0ad-438a-be66-6eacd04e943d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:12:54.126636 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.auth.core [None req-e01cb157-a0ad-438a-be66-6eacd04e943d None None] MFA Rules not processed for user `ae863915635746d1ac19970949de4722`. Rule list: `[]` (Enabled: `True`). {{(pid=81765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:12:54.127760 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-e01cb157-a0ad-438a-be66-6eacd04e943d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:12:54.194408 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:12:54.223087 dv-cinder-862365-1-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 550/1110] 127.0.0.1 () {58 vars in 998 bytes} [Fri Oct 28 19:12:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 19:12:54.372540 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b01534e-7847-429c-a300-ecaff5704f39 None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:12:54.374091 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-0b01534e-7847-429c-a300-ecaff5704f39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:12:54.391775 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:12:54.517770 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b01534e-7847-429c-a300-ecaff5704f39 None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:12:54.604128 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:12:54.629177 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae0d2f3-503e-4ec0-be75-1dba0fa87c0d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8877180cd9844dad8b0980de34769ec8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b705897907f042c0818a931052438e1e', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:12:54.629819 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae0d2f3-503e-4ec0-be75-1dba0fa87c0d service nova] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:12:54.630095 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae0d2f3-503e-4ec0-be75-1dba0fa87c0d service nova] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:12:54.630359 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae0d2f3-503e-4ec0-be75-1dba0fa87c0d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:12:54.631936 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-5ae0d2f3-503e-4ec0-be75-1dba0fa87c0d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:12:54.730279 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae0d2f3-503e-4ec0-be75-1dba0fa87c0d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:12:54.731780 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae0d2f3-503e-4ec0-be75-1dba0fa87c0d service nova] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:12:54.749987 dv-cinder-862365-1-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 561/1111] 10.222.0.23 () {60 vars in 1365 bytes} [Fri Oct 28 19:12:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 19:12:55.830863 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cad556-8bca-40bb-b6cd-b8adc965b16e None None] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:12:55.831436 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cad556-8bca-40bb-b6cd-b8adc965b16e None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:12:55.831436 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cad556-8bca-40bb-b6cd-b8adc965b16e None None] PATH_INFO: `/` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:12:55.832753 dv-cinder-862365-1-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 551/1112] 127.0.0.1 () {54 vars in 901 bytes} [Fri Oct 28 19:12:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 19:12:55.837734 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b576bfa-b4bf-44c8-bbb5-32e372a91419 None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:12:55.838186 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b576bfa-b4bf-44c8-bbb5-32e372a91419 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:12:55.838315 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b576bfa-b4bf-44c8-bbb5-32e372a91419 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:12:55.914359 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-8b576bfa-b4bf-44c8-bbb5-32e372a91419 None None] MFA Rules not processed for user `ae863915635746d1ac19970949de4722`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:12:55.915536 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-8b576bfa-b4bf-44c8-bbb5-32e372a91419 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:12:55.955548 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:12:56.010625 dv-cinder-862365-1-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 562/1113] 127.0.0.1 () {58 vars in 998 bytes} [Fri Oct 28 19:12:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 19:12:56.159467 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45cad556-8bca-40bb-b6cd-b8adc965b16e None None] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:12:56.160908 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-45cad556-8bca-40bb-b6cd-b8adc965b16e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:12:56.305208 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45cad556-8bca-40bb-b6cd-b8adc965b16e None None] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:12:56.359505 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:12:56.418300 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c8509b-5b25-479e-a597-3515cdc21c43 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8877180cd9844dad8b0980de34769ec8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b705897907f042c0818a931052438e1e', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:12:56.418838 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c8509b-5b25-479e-a597-3515cdc21c43 service nova] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:12:56.419122 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c8509b-5b25-479e-a597-3515cdc21c43 service nova] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:12:56.419400 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c8509b-5b25-479e-a597-3515cdc21c43 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:12:56.420996 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-98c8509b-5b25-479e-a597-3515cdc21c43 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:12:56.509955 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c8509b-5b25-479e-a597-3515cdc21c43 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:12:56.511530 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c8509b-5b25-479e-a597-3515cdc21c43 service nova] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:12:56.528901 dv-cinder-862365-1-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 552/1114] 10.222.0.23 () {60 vars in 1365 bytes} [Fri Oct 28 19:12:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 19:12:57.616275 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7e4d2d-47d7-48c4-aac4-4bfc56173caa None None] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:12:57.617094 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7e4d2d-47d7-48c4-aac4-4bfc56173caa None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:12:57.617254 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7e4d2d-47d7-48c4-aac4-4bfc56173caa None None] PATH_INFO: `/` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:12:57.618692 dv-cinder-862365-1-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 563/1115] 127.0.0.1 () {54 vars in 901 bytes} [Fri Oct 28 19:12:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 19:12:57.623443 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cb2db8-10cf-4c75-a767-9d221408707f None None] REQUEST_METHOD: `POST` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:12:57.623878 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cb2db8-10cf-4c75-a767-9d221408707f None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:12:57.623989 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cb2db8-10cf-4c75-a767-9d221408707f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:12:57.699117 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.auth.core [None req-82cb2db8-10cf-4c75-a767-9d221408707f None None] MFA Rules not processed for user `ae863915635746d1ac19970949de4722`. Rule list: `[]` (Enabled: `True`). {{(pid=81765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:12:57.700324 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-82cb2db8-10cf-4c75-a767-9d221408707f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:12:57.702343 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:12:57.797318 dv-cinder-862365-1-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 553/1116] 127.0.0.1 () {58 vars in 998 bytes} [Fri Oct 28 19:12:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 19:12:57.946310 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7e4d2d-47d7-48c4-aac4-4bfc56173caa None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:12:57.947778 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-dc7e4d2d-47d7-48c4-aac4-4bfc56173caa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:12:58.092667 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7e4d2d-47d7-48c4-aac4-4bfc56173caa None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:12:58.120259 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:12:58.205420 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b58b7d-a011-4c82-a5c6-0a9cbb75cfe2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8877180cd9844dad8b0980de34769ec8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b705897907f042c0818a931052438e1e', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:12:58.206023 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b58b7d-a011-4c82-a5c6-0a9cbb75cfe2 service nova] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:12:58.206305 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b58b7d-a011-4c82-a5c6-0a9cbb75cfe2 service nova] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:12:58.206588 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b58b7d-a011-4c82-a5c6-0a9cbb75cfe2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:12:58.208182 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-f4b58b7d-a011-4c82-a5c6-0a9cbb75cfe2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:12:58.296082 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b58b7d-a011-4c82-a5c6-0a9cbb75cfe2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:12:58.297978 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b58b7d-a011-4c82-a5c6-0a9cbb75cfe2 service nova] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:12:58.316103 dv-cinder-862365-1-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 564/1117] 10.222.0.23 () {60 vars in 1365 bytes} [Fri Oct 28 19:12:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 19:13:00.385781 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c90c80e-32c7-467e-aaef-55ade534cfdb None None] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:13:00.386386 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c90c80e-32c7-467e-aaef-55ade534cfdb None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:13:00.386386 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c90c80e-32c7-467e-aaef-55ade534cfdb None None] PATH_INFO: `/` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:13:00.387667 dv-cinder-862365-1-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 554/1118] 127.0.0.1 () {54 vars in 917 bytes} [Fri Oct 28 19:13:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 19:13:00.393005 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbcbbe4-68fa-4dfa-af99-d9b1a18e0ed0 None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:13:00.393433 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbcbbe4-68fa-4dfa-af99-d9b1a18e0ed0 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:13:00.393587 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbcbbe4-68fa-4dfa-af99-d9b1a18e0ed0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:13:00.434136 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:13:00.459398 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-2bbcbbe4-68fa-4dfa-af99-d9b1a18e0ed0 None None] MFA Rules not processed for user `ae863915635746d1ac19970949de4722`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:13:00.460602 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-2bbcbbe4-68fa-4dfa-af99-d9b1a18e0ed0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:13:00.556137 dv-cinder-862365-1-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 565/1119] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Oct 28 19:13:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 19:13:00.849369 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c90c80e-32c7-467e-aaef-55ade534cfdb None None] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:13:00.850909 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-9c90c80e-32c7-467e-aaef-55ade534cfdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:13:00.953295 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c90c80e-32c7-467e-aaef-55ade534cfdb None None] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:13:00.986187 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:13:01.027255 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d521a04a-3531-4789-966f-e44684203f40 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a31a9efd8dc04c9aa64c42a3779c550d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b705897907f042c0818a931052438e1e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:13:01.027779 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d521a04a-3531-4789-966f-e44684203f40 service neutron] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:13:01.028061 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d521a04a-3531-4789-966f-e44684203f40 service neutron] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:13:01.028334 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d521a04a-3531-4789-966f-e44684203f40 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:13:01.029963 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-d521a04a-3531-4789-966f-e44684203f40 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:13:01.138820 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d521a04a-3531-4789-966f-e44684203f40 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:13:01.140264 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d521a04a-3531-4789-966f-e44684203f40 service neutron] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:13:01.158875 dv-cinder-862365-1-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 555/1120] 10.222.0.23 () {60 vars in 1365 bytes} [Fri Oct 28 19:13:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 19:13:03.548761 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046d8451-8641-4a67-832b-b386a817f310 None None] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:13:03.549301 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046d8451-8641-4a67-832b-b386a817f310 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:13:03.549301 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046d8451-8641-4a67-832b-b386a817f310 None None] PATH_INFO: `/` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:13:03.550689 dv-cinder-862365-1-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 566/1121] 127.0.0.1 () {54 vars in 917 bytes} [Fri Oct 28 19:13:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 19:13:03.555901 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69d018f-a7fe-40d4-8992-c1a221c27aa6 None None] REQUEST_METHOD: `POST` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:13:03.556341 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69d018f-a7fe-40d4-8992-c1a221c27aa6 None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:13:03.556490 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69d018f-a7fe-40d4-8992-c1a221c27aa6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:13:03.622668 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.auth.core [None req-e69d018f-a7fe-40d4-8992-c1a221c27aa6 None None] MFA Rules not processed for user `ae863915635746d1ac19970949de4722`. Rule list: `[]` (Enabled: `True`). {{(pid=81765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:13:03.623870 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-e69d018f-a7fe-40d4-8992-c1a221c27aa6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:13:03.636878 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:13:03.719716 dv-cinder-862365-1-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 556/1122] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Oct 28 19:13:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 19:13:04.006604 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046d8451-8641-4a67-832b-b386a817f310 None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:13:04.008878 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-046d8451-8641-4a67-832b-b386a817f310 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:13:04.111297 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046d8451-8641-4a67-832b-b386a817f310 None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:13:04.124736 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:13:04.186059 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-decf40bb-6fd5-4594-b33e-5bfe0d47303a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a31a9efd8dc04c9aa64c42a3779c550d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b705897907f042c0818a931052438e1e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:13:04.186653 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decf40bb-6fd5-4594-b33e-5bfe0d47303a service neutron] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:13:04.186927 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decf40bb-6fd5-4594-b33e-5bfe0d47303a service neutron] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:13:04.187195 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decf40bb-6fd5-4594-b33e-5bfe0d47303a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:13:04.188773 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-decf40bb-6fd5-4594-b33e-5bfe0d47303a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:13:04.295020 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-decf40bb-6fd5-4594-b33e-5bfe0d47303a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:13:04.296483 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-decf40bb-6fd5-4594-b33e-5bfe0d47303a service neutron] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:13:04.314559 dv-cinder-862365-1-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 567/1123] 10.222.0.23 () {60 vars in 1365 bytes} [Fri Oct 28 19:13:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 19:13:06.842694 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f0fc89-b9f1-48d8-8a3a-f76833102a2e None None] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:13:06.843254 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f0fc89-b9f1-48d8-8a3a-f76833102a2e None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:13:06.843254 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f0fc89-b9f1-48d8-8a3a-f76833102a2e None None] PATH_INFO: `/` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:13:06.844849 dv-cinder-862365-1-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 557/1124] 127.0.0.1 () {54 vars in 917 bytes} [Fri Oct 28 19:13:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 19:13:06.850260 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092d3f33-a253-4945-a7b4-7954b1df54a5 None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:13:06.850657 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092d3f33-a253-4945-a7b4-7954b1df54a5 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:13:06.850807 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092d3f33-a253-4945-a7b4-7954b1df54a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:13:06.897474 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:13:06.915776 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-092d3f33-a253-4945-a7b4-7954b1df54a5 None None] MFA Rules not processed for user `ae863915635746d1ac19970949de4722`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:13:06.916964 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-092d3f33-a253-4945-a7b4-7954b1df54a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:13:07.012840 dv-cinder-862365-1-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 568/1125] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Oct 28 19:13:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 19:13:07.293738 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f0fc89-b9f1-48d8-8a3a-f76833102a2e None None] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:13:07.295286 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-a2f0fc89-b9f1-48d8-8a3a-f76833102a2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:13:07.399805 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f0fc89-b9f1-48d8-8a3a-f76833102a2e None None] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:13:07.439529 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:13:07.474905 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6962cecb-cbae-4d36-be27-7b60e3b698bd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a31a9efd8dc04c9aa64c42a3779c550d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b705897907f042c0818a931052438e1e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:13:07.475519 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6962cecb-cbae-4d36-be27-7b60e3b698bd service neutron] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:13:07.475801 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6962cecb-cbae-4d36-be27-7b60e3b698bd service neutron] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:13:07.476277 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6962cecb-cbae-4d36-be27-7b60e3b698bd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:13:07.477708 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-6962cecb-cbae-4d36-be27-7b60e3b698bd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:13:07.589079 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6962cecb-cbae-4d36-be27-7b60e3b698bd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:13:07.590447 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6962cecb-cbae-4d36-be27-7b60e3b698bd service neutron] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:13:07.608673 dv-cinder-862365-1-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 558/1126] 10.222.0.23 () {60 vars in 1365 bytes} [Fri Oct 28 19:13:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 19:13:09.891947 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e307144-ae08-4f39-a199-f97ca9e8a774 None None] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:13:09.892474 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e307144-ae08-4f39-a199-f97ca9e8a774 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:13:09.892474 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e307144-ae08-4f39-a199-f97ca9e8a774 None None] PATH_INFO: `/` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:13:09.893853 dv-cinder-862365-1-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 569/1127] 127.0.0.1 () {54 vars in 917 bytes} [Fri Oct 28 19:13:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 19:13:09.899136 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe260af-be45-4873-b320-11e3718e2ac6 None None] REQUEST_METHOD: `POST` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:13:09.899592 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe260af-be45-4873-b320-11e3718e2ac6 None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:13:09.899697 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe260af-be45-4873-b320-11e3718e2ac6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:13:09.964190 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.auth.core [None req-3fe260af-be45-4873-b320-11e3718e2ac6 None None] MFA Rules not processed for user `ae863915635746d1ac19970949de4722`. Rule list: `[]` (Enabled: `True`). {{(pid=81765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:13:09.965418 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-3fe260af-be45-4873-b320-11e3718e2ac6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:13:09.985790 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:13:10.063955 dv-cinder-862365-1-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 559/1128] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Oct 28 19:13:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 19:13:10.348053 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e307144-ae08-4f39-a199-f97ca9e8a774 None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:13:10.349603 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-9e307144-ae08-4f39-a199-f97ca9e8a774 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:13:10.454229 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e307144-ae08-4f39-a199-f97ca9e8a774 None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:13:10.475091 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:13:10.527975 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95bfb86a-8406-41fd-b546-c38dd842889a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a31a9efd8dc04c9aa64c42a3779c550d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b705897907f042c0818a931052438e1e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:13:10.528572 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bfb86a-8406-41fd-b546-c38dd842889a service neutron] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:13:10.528845 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bfb86a-8406-41fd-b546-c38dd842889a service neutron] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:13:10.529112 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bfb86a-8406-41fd-b546-c38dd842889a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:13:10.530710 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-95bfb86a-8406-41fd-b546-c38dd842889a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:13:10.637220 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95bfb86a-8406-41fd-b546-c38dd842889a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:13:10.638590 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95bfb86a-8406-41fd-b546-c38dd842889a service neutron] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:13:10.655929 dv-cinder-862365-1-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 570/1129] 10.222.0.23 () {60 vars in 1365 bytes} [Fri Oct 28 19:13:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 19:13:12.856466 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4db2c7-e01e-4382-bb9e-94c090d736dc None None] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:13:12.856911 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4db2c7-e01e-4382-bb9e-94c090d736dc None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:13:12.857007 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4db2c7-e01e-4382-bb9e-94c090d736dc None None] PATH_INFO: `/` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:13:12.858406 dv-cinder-862365-1-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 560/1130] 127.0.0.1 () {54 vars in 917 bytes} [Fri Oct 28 19:13:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 19:13:12.863658 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9dd830-55e0-4c66-b07b-77041d5313ae None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:13:12.864055 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9dd830-55e0-4c66-b07b-77041d5313ae None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:13:12.864197 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9dd830-55e0-4c66-b07b-77041d5313ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:13:12.934437 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:13:12.937037 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-0d9dd830-55e0-4c66-b07b-77041d5313ae None None] MFA Rules not processed for user `ae863915635746d1ac19970949de4722`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:13:12.938278 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-0d9dd830-55e0-4c66-b07b-77041d5313ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:13:13.036047 dv-cinder-862365-1-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 571/1131] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Oct 28 19:13:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 19:13:13.323531 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4db2c7-e01e-4382-bb9e-94c090d736dc None None] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:13:13.325078 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-6d4db2c7-e01e-4382-bb9e-94c090d736dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:13:13.424872 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4db2c7-e01e-4382-bb9e-94c090d736dc None None] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:13:13.477420 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:13:13.502057 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b50c565-6ba1-4f92-b2e2-3bb341fd21a4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a31a9efd8dc04c9aa64c42a3779c550d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b705897907f042c0818a931052438e1e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:13:13.502670 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b50c565-6ba1-4f92-b2e2-3bb341fd21a4 service neutron] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:13:13.502948 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b50c565-6ba1-4f92-b2e2-3bb341fd21a4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:13:13.503220 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b50c565-6ba1-4f92-b2e2-3bb341fd21a4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:13:13.504823 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-2b50c565-6ba1-4f92-b2e2-3bb341fd21a4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:13:13.616288 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b50c565-6ba1-4f92-b2e2-3bb341fd21a4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:13:13.617696 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b50c565-6ba1-4f92-b2e2-3bb341fd21a4 service neutron] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:13:13.637040 dv-cinder-862365-1-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 561/1132] 10.222.0.23 () {60 vars in 1365 bytes} [Fri Oct 28 19:13:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 19:13:15.867691 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3555432e-5bc1-4abd-9a3f-756bf7e23e6d None None] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:13:15.868148 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3555432e-5bc1-4abd-9a3f-756bf7e23e6d None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:13:15.868268 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3555432e-5bc1-4abd-9a3f-756bf7e23e6d None None] PATH_INFO: `/` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:13:15.869623 dv-cinder-862365-1-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 572/1133] 127.0.0.1 () {54 vars in 917 bytes} [Fri Oct 28 19:13:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 19:13:15.874888 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81b9d7a-db3d-4b2d-b1c5-6fd1b4dc7213 None None] REQUEST_METHOD: `POST` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:13:15.875336 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81b9d7a-db3d-4b2d-b1c5-6fd1b4dc7213 None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:13:15.875445 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81b9d7a-db3d-4b2d-b1c5-6fd1b4dc7213 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:13:15.941545 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.auth.core [None req-c81b9d7a-db3d-4b2d-b1c5-6fd1b4dc7213 None None] MFA Rules not processed for user `ae863915635746d1ac19970949de4722`. Rule list: `[]` (Enabled: `True`). {{(pid=81765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:13:15.942752 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-c81b9d7a-db3d-4b2d-b1c5-6fd1b4dc7213 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:13:15.971810 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:13:16.038368 dv-cinder-862365-1-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 562/1134] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Oct 28 19:13:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 19:13:16.321903 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3555432e-5bc1-4abd-9a3f-756bf7e23e6d None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:13:16.323449 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-3555432e-5bc1-4abd-9a3f-756bf7e23e6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:13:16.425083 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3555432e-5bc1-4abd-9a3f-756bf7e23e6d None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:13:16.453339 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:13:16.498379 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094b2d3a-e53c-4e6d-a77b-4fc8bcf03928 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a31a9efd8dc04c9aa64c42a3779c550d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b705897907f042c0818a931052438e1e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:13:16.498984 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094b2d3a-e53c-4e6d-a77b-4fc8bcf03928 service neutron] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:13:16.499264 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094b2d3a-e53c-4e6d-a77b-4fc8bcf03928 service neutron] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:13:16.499700 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094b2d3a-e53c-4e6d-a77b-4fc8bcf03928 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:13:16.502117 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-094b2d3a-e53c-4e6d-a77b-4fc8bcf03928 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:13:16.608642 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094b2d3a-e53c-4e6d-a77b-4fc8bcf03928 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:13:16.610035 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094b2d3a-e53c-4e6d-a77b-4fc8bcf03928 service neutron] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:13:16.628431 dv-cinder-862365-1-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 573/1135] 10.222.0.23 () {60 vars in 1365 bytes} [Fri Oct 28 19:13:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 19:13:18.834576 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc2f83b-c090-4ec8-8e51-3ec13cbc2f75 None None] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:13:18.835046 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc2f83b-c090-4ec8-8e51-3ec13cbc2f75 None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:13:18.835175 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc2f83b-c090-4ec8-8e51-3ec13cbc2f75 None None] PATH_INFO: `/` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:13:18.836446 dv-cinder-862365-1-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 563/1136] 127.0.0.1 () {54 vars in 917 bytes} [Fri Oct 28 19:13:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 19:13:18.842083 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5da296-e35b-47e4-b33b-98af1ddf7c5f None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:13:18.842868 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5da296-e35b-47e4-b33b-98af1ddf7c5f None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:13:18.843246 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5da296-e35b-47e4-b33b-98af1ddf7c5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:13:18.910246 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-aa5da296-e35b-47e4-b33b-98af1ddf7c5f None None] MFA Rules not processed for user `ae863915635746d1ac19970949de4722`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:13:18.911495 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-aa5da296-e35b-47e4-b33b-98af1ddf7c5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:13:18.920066 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:13:19.020765 dv-cinder-862365-1-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 574/1137] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Oct 28 19:13:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 19:13:19.316748 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc2f83b-c090-4ec8-8e51-3ec13cbc2f75 None None] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:13:19.318350 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-dfc2f83b-c090-4ec8-8e51-3ec13cbc2f75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:13:19.421864 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc2f83b-c090-4ec8-8e51-3ec13cbc2f75 None None] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:13:19.477695 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:13:19.496436 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2855a39-3f0a-47c5-97fa-c95fce1f411f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a31a9efd8dc04c9aa64c42a3779c550d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b705897907f042c0818a931052438e1e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:13:19.497036 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2855a39-3f0a-47c5-97fa-c95fce1f411f service neutron] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:13:19.497315 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2855a39-3f0a-47c5-97fa-c95fce1f411f service neutron] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:13:19.497628 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2855a39-3f0a-47c5-97fa-c95fce1f411f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:13:19.499214 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-c2855a39-3f0a-47c5-97fa-c95fce1f411f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:13:19.610717 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2855a39-3f0a-47c5-97fa-c95fce1f411f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:13:19.612096 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2855a39-3f0a-47c5-97fa-c95fce1f411f service neutron] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:13:19.631144 dv-cinder-862365-1-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 564/1138] 10.222.0.23 () {60 vars in 1365 bytes} [Fri Oct 28 19:13:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 19:13:21.831946 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d72ed7e-af53-40b6-ad47-ab79c23db46c None None] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:13:21.832509 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d72ed7e-af53-40b6-ad47-ab79c23db46c None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:13:21.832509 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d72ed7e-af53-40b6-ad47-ab79c23db46c None None] PATH_INFO: `/` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:13:21.833857 dv-cinder-862365-1-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 575/1139] 127.0.0.1 () {54 vars in 917 bytes} [Fri Oct 28 19:13:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 19:13:21.839677 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac419b34-eb0f-4dd4-a13a-925e7a05b6fc None None] REQUEST_METHOD: `POST` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:13:21.840113 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac419b34-eb0f-4dd4-a13a-925e7a05b6fc None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:13:21.840241 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac419b34-eb0f-4dd4-a13a-925e7a05b6fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:13:21.906530 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.auth.core [None req-ac419b34-eb0f-4dd4-a13a-925e7a05b6fc None None] MFA Rules not processed for user `ae863915635746d1ac19970949de4722`. Rule list: `[]` (Enabled: `True`). {{(pid=81765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:13:21.907728 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-ac419b34-eb0f-4dd4-a13a-925e7a05b6fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:13:21.946158 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:13:22.003240 dv-cinder-862365-1-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 565/1140] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Oct 28 19:13:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 19:13:22.284426 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d72ed7e-af53-40b6-ad47-ab79c23db46c None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:13:22.285976 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-1d72ed7e-af53-40b6-ad47-ab79c23db46c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:13:22.388397 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d72ed7e-af53-40b6-ad47-ab79c23db46c None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:13:22.426125 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:13:22.461861 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63fb2996-53c9-4576-a448-4a2dc799ee04 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a31a9efd8dc04c9aa64c42a3779c550d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b705897907f042c0818a931052438e1e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:13:22.462458 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fb2996-53c9-4576-a448-4a2dc799ee04 service neutron] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:13:22.462734 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fb2996-53c9-4576-a448-4a2dc799ee04 service neutron] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:13:22.463004 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fb2996-53c9-4576-a448-4a2dc799ee04 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:13:22.464572 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-63fb2996-53c9-4576-a448-4a2dc799ee04 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:13:22.571144 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63fb2996-53c9-4576-a448-4a2dc799ee04 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:13:22.572473 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63fb2996-53c9-4576-a448-4a2dc799ee04 service neutron] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:13:22.591108 dv-cinder-862365-1-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 576/1141] 10.222.0.23 () {60 vars in 1365 bytes} [Fri Oct 28 19:13:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 28 19:13:24.765131 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860cf642-4da0-4769-babe-3e5c48b780ee None None] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:13:24.765734 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860cf642-4da0-4769-babe-3e5c48b780ee None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:13:24.765734 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860cf642-4da0-4769-babe-3e5c48b780ee None None] PATH_INFO: `/` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:13:24.767062 dv-cinder-862365-1-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 566/1142] 127.0.0.1 () {54 vars in 917 bytes} [Fri Oct 28 19:13:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 19:13:24.773204 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1165fdf-3dd5-4e94-a866-5a5f1911d2a3 None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:13:24.773954 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1165fdf-3dd5-4e94-a866-5a5f1911d2a3 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:13:24.773954 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1165fdf-3dd5-4e94-a866-5a5f1911d2a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:13:24.846540 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-a1165fdf-3dd5-4e94-a866-5a5f1911d2a3 None None] MFA Rules not processed for user `ae863915635746d1ac19970949de4722`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:13:24.847746 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-a1165fdf-3dd5-4e94-a866-5a5f1911d2a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:13:24.865895 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:13:24.948925 dv-cinder-862365-1-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 577/1143] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Oct 28 19:13:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 19:13:25.255061 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860cf642-4da0-4769-babe-3e5c48b780ee None None] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:13:25.256634 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-860cf642-4da0-4769-babe-3e5c48b780ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:13:25.360014 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860cf642-4da0-4769-babe-3e5c48b780ee None None] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:13:25.425477 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:13:25.432405 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8ed609-d823-442c-85bb-dc91758c6076 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a31a9efd8dc04c9aa64c42a3779c550d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b705897907f042c0818a931052438e1e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:13:25.433009 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8ed609-d823-442c-85bb-dc91758c6076 service neutron] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:13:25.433283 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8ed609-d823-442c-85bb-dc91758c6076 service neutron] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:13:25.440006 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8ed609-d823-442c-85bb-dc91758c6076 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:13:25.440006 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-eb8ed609-d823-442c-85bb-dc91758c6076 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:13:25.552682 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8ed609-d823-442c-85bb-dc91758c6076 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:13:25.554088 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8ed609-d823-442c-85bb-dc91758c6076 service neutron] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:13:25.571539 dv-cinder-862365-1-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 567/1144] 10.222.0.23 () {60 vars in 1365 bytes} [Fri Oct 28 19:13:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 19:13:27.761601 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a49196-4e90-4f96-87af-27ed644575fd None None] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:13:27.762183 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a49196-4e90-4f96-87af-27ed644575fd None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:13:27.762183 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a49196-4e90-4f96-87af-27ed644575fd None None] PATH_INFO: `/` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:13:27.763532 dv-cinder-862365-1-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 578/1145] 127.0.0.1 () {54 vars in 917 bytes} [Fri Oct 28 19:13:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 19:13:27.769011 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6227d5d2-7bbd-452b-83ff-d33893216fbb None None] REQUEST_METHOD: `POST` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:13:27.769458 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6227d5d2-7bbd-452b-83ff-d33893216fbb None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:13:27.769596 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6227d5d2-7bbd-452b-83ff-d33893216fbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:13:27.835626 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.auth.core [None req-6227d5d2-7bbd-452b-83ff-d33893216fbb None None] MFA Rules not processed for user `ae863915635746d1ac19970949de4722`. Rule list: `[]` (Enabled: `True`). {{(pid=81765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:13:27.836820 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-6227d5d2-7bbd-452b-83ff-d33893216fbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:13:27.887235 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:13:27.935218 dv-cinder-862365-1-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 568/1146] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Oct 28 19:13:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 19:13:28.218372 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a49196-4e90-4f96-87af-27ed644575fd None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:13:28.220025 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-a2a49196-4e90-4f96-87af-27ed644575fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:13:28.325802 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a49196-4e90-4f96-87af-27ed644575fd None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:13:28.373035 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:13:28.398358 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f39f63-7a89-42ea-b051-6f90aec64b60 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a31a9efd8dc04c9aa64c42a3779c550d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b705897907f042c0818a931052438e1e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:13:28.399016 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f39f63-7a89-42ea-b051-6f90aec64b60 service neutron] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:13:28.399294 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f39f63-7a89-42ea-b051-6f90aec64b60 service neutron] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:13:28.399563 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f39f63-7a89-42ea-b051-6f90aec64b60 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:13:28.401155 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-b0f39f63-7a89-42ea-b051-6f90aec64b60 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:13:28.509760 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f39f63-7a89-42ea-b051-6f90aec64b60 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:13:28.511178 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f39f63-7a89-42ea-b051-6f90aec64b60 service neutron] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:13:28.528561 dv-cinder-862365-1-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 579/1147] 10.222.0.23 () {60 vars in 1365 bytes} [Fri Oct 28 19:13:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 19:13:37.933673 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=22 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:13:38.526352 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=66 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:13:48.611713 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265de551-6002-4c20-8a7d-fd824eb4e3ad None None] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:13:48.612285 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265de551-6002-4c20-8a7d-fd824eb4e3ad None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:13:48.612285 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265de551-6002-4c20-8a7d-fd824eb4e3ad None None] PATH_INFO: `/` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:13:48.613637 dv-cinder-862365-1-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 569/1148] 10.222.0.23 () {54 vars in 927 bytes} [Fri Oct 28 19:13:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 19:13:48.619344 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea87d6e-2aa8-4e1a-99b5-7bd9ec990a66 None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:13:48.619814 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea87d6e-2aa8-4e1a-99b5-7bd9ec990a66 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:13:48.619940 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea87d6e-2aa8-4e1a-99b5-7bd9ec990a66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:13:48.686261 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-cea87d6e-2aa8-4e1a-99b5-7bd9ec990a66 None None] MFA Rules not processed for user `ae863915635746d1ac19970949de4722`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:13:48.687470 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-cea87d6e-2aa8-4e1a-99b5-7bd9ec990a66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:13:48.784938 dv-cinder-862365-1-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 580/1149] 10.222.0.23 () {58 vars in 1024 bytes} [Fri Oct 28 19:13:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 19:13:49.082560 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76b42b5-3aaa-4cf9-a9ea-b59578ad44bc None None] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:13:49.082848 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76b42b5-3aaa-4cf9-a9ea-b59578ad44bc None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:13:49.083132 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76b42b5-3aaa-4cf9-a9ea-b59578ad44bc None None] PATH_INFO: `/` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:13:49.085054 dv-cinder-862365-1-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 570/1150] 10.222.0.23 () {54 vars in 962 bytes} [Fri Oct 28 19:13:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 19:13:49.090181 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0392d04a-e262-4945-a4ea-7ac4b91011aa None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:13:49.090471 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0392d04a-e262-4945-a4ea-7ac4b91011aa None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:13:49.090751 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0392d04a-e262-4945-a4ea-7ac4b91011aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:13:49.169214 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-0392d04a-e262-4945-a4ea-7ac4b91011aa None None] MFA Rules not processed for user `e441de25d614487c80452642c67df04a`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:13:49.170385 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-0392d04a-e262-4945-a4ea-7ac4b91011aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:13:49.191150 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:13:49.245960 dv-cinder-862365-1-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 581/1151] 10.222.0.23 () {58 vars in 1059 bytes} [Fri Oct 28 19:13:49 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 19:13:49.253775 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76b42b5-3aaa-4cf9-a9ea-b59578ad44bc None None] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:13:49.255274 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-e76b42b5-3aaa-4cf9-a9ea-b59578ad44bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:13:49.357286 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76b42b5-3aaa-4cf9-a9ea-b59578ad44bc None None] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:13:49.434636 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71836409-7268-45cc-8c5f-8996970309a8 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e441de25d614487c80452642c67df04a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b705897907f042c0818a931052438e1e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:13:49.435157 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71836409-7268-45cc-8c5f-8996970309a8 service glance] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:13:49.435434 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71836409-7268-45cc-8c5f-8996970309a8 service glance] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:13:49.435705 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71836409-7268-45cc-8c5f-8996970309a8 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:13:49.437412 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-71836409-7268-45cc-8c5f-8996970309a8 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:13:49.490575 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:13:49.545537 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71836409-7268-45cc-8c5f-8996970309a8 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:13:49.546968 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71836409-7268-45cc-8c5f-8996970309a8 service glance] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:13:49.566090 dv-cinder-862365-1-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 571/1152] 10.222.0.23 () {60 vars in 1365 bytes} [Fri Oct 28 19:13:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 19:13:51.830854 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e33a84-68c0-4a4d-86e8-f0d7e5a1fccd None None] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:13:51.831398 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e33a84-68c0-4a4d-86e8-f0d7e5a1fccd None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:13:51.831398 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e33a84-68c0-4a4d-86e8-f0d7e5a1fccd None None] PATH_INFO: `/` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:13:51.832746 dv-cinder-862365-1-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 582/1153] 10.222.0.23 () {54 vars in 927 bytes} [Fri Oct 28 19:13:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 19:13:51.838659 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d1bd61-3f4d-4444-8f01-341171ab2e46 None None] REQUEST_METHOD: `POST` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:13:51.839091 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d1bd61-3f4d-4444-8f01-341171ab2e46 None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:13:51.839193 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d1bd61-3f4d-4444-8f01-341171ab2e46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:13:51.905761 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.auth.core [None req-63d1bd61-3f4d-4444-8f01-341171ab2e46 None None] MFA Rules not processed for user `ae863915635746d1ac19970949de4722`. Rule list: `[]` (Enabled: `True`). {{(pid=81765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:13:51.906963 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-63d1bd61-3f4d-4444-8f01-341171ab2e46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:13:52.003122 dv-cinder-862365-1-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 572/1154] 10.222.0.23 () {58 vars in 1024 bytes} [Fri Oct 28 19:13:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 19:13:52.277825 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e33a84-68c0-4a4d-86e8-f0d7e5a1fccd None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:13:52.279366 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-75e33a84-68c0-4a4d-86e8-f0d7e5a1fccd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:13:52.402140 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e33a84-68c0-4a4d-86e8-f0d7e5a1fccd None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:13:52.449719 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:13:52.493583 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79897f7c-400d-4844-a7a4-a268714052c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae863915635746d1ac19970949de4722', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b7477232f9249b8beb26277f784d073', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:13:52.494174 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79897f7c-400d-4844-a7a4-a268714052c9 admin admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:13:52.494455 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79897f7c-400d-4844-a7a4-a268714052c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:13:52.494724 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79897f7c-400d-4844-a7a4-a268714052c9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:13:52.495355 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79897f7c-400d-4844-a7a4-a268714052c9 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:13:52.496454 dv-cinder-862365-1-smb devstack@keystone.service[81766]: WARNING py.warnings [None req-79897f7c-400d-4844-a7a4-a268714052c9 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 28 19:13:52.496454 dv-cinder-862365-1-smb devstack@keystone.service[81766]: warnings.warn(msg) Oct 28 19:13:52.496454 dv-cinder-862365-1-smb devstack@keystone.service[81766]: Oct 28 19:13:52.497621 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79897f7c-400d-4844-a7a4-a268714052c9 admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:13:52.516893 dv-cinder-862365-1-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 583/1155] 10.222.0.23 () {56 vars in 1108 bytes} [Fri Oct 28 19:13:52 2022] GET /identity/v3/projects => generated 2553 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 19:13:54.681679 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab275d32-850e-4e48-b121-efbd50cb70ff None None] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:13:54.682262 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab275d32-850e-4e48-b121-efbd50cb70ff None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:13:54.682262 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab275d32-850e-4e48-b121-efbd50cb70ff None None] PATH_INFO: `/` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:13:54.683607 dv-cinder-862365-1-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 573/1156] 10.222.0.23 () {54 vars in 927 bytes} [Fri Oct 28 19:13:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 19:13:54.688716 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916d1e24-e3b1-470b-9d5d-23273fe2e0be None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:13:54.689161 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916d1e24-e3b1-470b-9d5d-23273fe2e0be None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:13:54.689419 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916d1e24-e3b1-470b-9d5d-23273fe2e0be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:13:54.756970 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-916d1e24-e3b1-470b-9d5d-23273fe2e0be None None] MFA Rules not processed for user `ae863915635746d1ac19970949de4722`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:13:54.758204 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-916d1e24-e3b1-470b-9d5d-23273fe2e0be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:13:54.856665 dv-cinder-862365-1-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 584/1157] 10.222.0.23 () {58 vars in 1024 bytes} [Fri Oct 28 19:13:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 19:13:55.152918 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab275d32-850e-4e48-b121-efbd50cb70ff None None] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:13:55.154499 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-ab275d32-850e-4e48-b121-efbd50cb70ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:13:55.164928 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:13:55.299568 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab275d32-850e-4e48-b121-efbd50cb70ff None None] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:13:55.378617 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:13:55.410913 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b50bd0c-e2a8-4490-a697-4f5c4b9b8cc7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8877180cd9844dad8b0980de34769ec8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b705897907f042c0818a931052438e1e', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:13:55.411445 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b50bd0c-e2a8-4490-a697-4f5c4b9b8cc7 service nova] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:13:55.411727 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b50bd0c-e2a8-4490-a697-4f5c4b9b8cc7 service nova] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:13:55.411999 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b50bd0c-e2a8-4490-a697-4f5c4b9b8cc7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:13:55.414172 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-9b50bd0c-e2a8-4490-a697-4f5c4b9b8cc7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:13:55.515511 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b50bd0c-e2a8-4490-a697-4f5c4b9b8cc7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:13:55.517085 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b50bd0c-e2a8-4490-a697-4f5c4b9b8cc7 service nova] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:13:55.534988 dv-cinder-862365-1-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 574/1158] 10.222.0.23 () {60 vars in 1365 bytes} [Fri Oct 28 19:13:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 382 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 19:13:57.865087 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278c5e93-da5a-4b97-ba84-a9ecafda80a2 None None] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:13:57.866106 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278c5e93-da5a-4b97-ba84-a9ecafda80a2 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:13:57.866216 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278c5e93-da5a-4b97-ba84-a9ecafda80a2 None None] PATH_INFO: `/` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:13:57.867493 dv-cinder-862365-1-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 585/1159] 10.222.0.23 () {54 vars in 927 bytes} [Fri Oct 28 19:13:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 19:13:57.872695 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cf38a5-19eb-4a2f-b26b-6c2f99c3e7e9 None None] REQUEST_METHOD: `POST` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:13:57.873144 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cf38a5-19eb-4a2f-b26b-6c2f99c3e7e9 None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:13:57.873276 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cf38a5-19eb-4a2f-b26b-6c2f99c3e7e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:13:57.939403 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.auth.core [None req-64cf38a5-19eb-4a2f-b26b-6c2f99c3e7e9 None None] MFA Rules not processed for user `ae863915635746d1ac19970949de4722`. Rule list: `[]` (Enabled: `True`). {{(pid=81765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:13:57.940620 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-64cf38a5-19eb-4a2f-b26b-6c2f99c3e7e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:13:57.986541 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:13:58.036924 dv-cinder-862365-1-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 575/1160] 10.222.0.23 () {58 vars in 1024 bytes} [Fri Oct 28 19:13:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 19:13:58.323042 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278c5e93-da5a-4b97-ba84-a9ecafda80a2 None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:13:58.324586 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-278c5e93-da5a-4b97-ba84-a9ecafda80a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:13:58.349442 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:13:58.426949 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278c5e93-da5a-4b97-ba84-a9ecafda80a2 None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:13:58.500766 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d8b0bd-6b1d-4b70-8c69-c5cca89357e7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a31a9efd8dc04c9aa64c42a3779c550d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b705897907f042c0818a931052438e1e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:13:58.501377 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d8b0bd-6b1d-4b70-8c69-c5cca89357e7 service neutron] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:13:58.501664 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d8b0bd-6b1d-4b70-8c69-c5cca89357e7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:13:58.501936 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d8b0bd-6b1d-4b70-8c69-c5cca89357e7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:13:58.503563 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-c4d8b0bd-6b1d-4b70-8c69-c5cca89357e7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:13:58.576092 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:13:58.611339 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d8b0bd-6b1d-4b70-8c69-c5cca89357e7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:13:58.612764 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d8b0bd-6b1d-4b70-8c69-c5cca89357e7 service neutron] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:13:58.630878 dv-cinder-862365-1-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 586/1161] 10.222.0.23 () {60 vars in 1365 bytes} [Fri Oct 28 19:13:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 19:14:00.830819 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d380ade7-ce59-465a-9fec-725a66c33444 None None] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:14:00.831364 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d380ade7-ce59-465a-9fec-725a66c33444 None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:14:00.831364 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d380ade7-ce59-465a-9fec-725a66c33444 None None] PATH_INFO: `/` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:14:00.832742 dv-cinder-862365-1-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 576/1162] 10.222.0.23 () {54 vars in 927 bytes} [Fri Oct 28 19:14:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 19:14:00.838187 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff079263-5a20-4701-afcd-01a8190868b3 None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:14:00.838614 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff079263-5a20-4701-afcd-01a8190868b3 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:14:00.838808 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff079263-5a20-4701-afcd-01a8190868b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:14:00.904515 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-ff079263-5a20-4701-afcd-01a8190868b3 None None] MFA Rules not processed for user `ae863915635746d1ac19970949de4722`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:14:00.905747 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-ff079263-5a20-4701-afcd-01a8190868b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:14:01.000266 dv-cinder-862365-1-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 587/1163] 10.222.0.23 () {58 vars in 1024 bytes} [Fri Oct 28 19:14:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 19:14:01.294422 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d380ade7-ce59-465a-9fec-725a66c33444 None None] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:14:01.295986 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-d380ade7-ce59-465a-9fec-725a66c33444 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:14:01.402664 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d380ade7-ce59-465a-9fec-725a66c33444 None None] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:14:01.473310 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:14:01.474819 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0230773-4082-450a-b8d2-66b61036e459 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a31a9efd8dc04c9aa64c42a3779c550d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b705897907f042c0818a931052438e1e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:14:01.475426 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0230773-4082-450a-b8d2-66b61036e459 service neutron] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:14:01.475708 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0230773-4082-450a-b8d2-66b61036e459 service neutron] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:14:01.475984 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0230773-4082-450a-b8d2-66b61036e459 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:14:01.478138 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-a0230773-4082-450a-b8d2-66b61036e459 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:14:01.593967 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0230773-4082-450a-b8d2-66b61036e459 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:14:01.595317 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0230773-4082-450a-b8d2-66b61036e459 service neutron] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:14:01.613361 dv-cinder-862365-1-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 577/1164] 10.222.0.23 () {60 vars in 1365 bytes} [Fri Oct 28 19:14:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 19:14:03.885971 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240ba503-ea82-4f84-96eb-17c89bfb2d80 None None] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:14:03.886530 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240ba503-ea82-4f84-96eb-17c89bfb2d80 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:14:03.886530 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240ba503-ea82-4f84-96eb-17c89bfb2d80 None None] PATH_INFO: `/` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:14:03.887912 dv-cinder-862365-1-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 588/1165] 10.222.0.23 () {54 vars in 927 bytes} [Fri Oct 28 19:14:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 19:14:03.893027 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64cbee9-c02a-4c15-bcbf-136247aa1f59 None None] REQUEST_METHOD: `POST` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:14:03.897310 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64cbee9-c02a-4c15-bcbf-136247aa1f59 None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:14:03.897310 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64cbee9-c02a-4c15-bcbf-136247aa1f59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:14:03.962959 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.auth.core [None req-c64cbee9-c02a-4c15-bcbf-136247aa1f59 None None] MFA Rules not processed for user `ae863915635746d1ac19970949de4722`. Rule list: `[]` (Enabled: `True`). {{(pid=81765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:14:03.964171 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-c64cbee9-c02a-4c15-bcbf-136247aa1f59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:14:04.018888 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:14:04.064385 dv-cinder-862365-1-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 578/1166] 10.222.0.23 () {58 vars in 1024 bytes} [Fri Oct 28 19:14:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 19:14:04.356314 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240ba503-ea82-4f84-96eb-17c89bfb2d80 None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:14:04.357963 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-240ba503-ea82-4f84-96eb-17c89bfb2d80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:14:04.393726 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:14:04.464874 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240ba503-ea82-4f84-96eb-17c89bfb2d80 None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:14:04.537243 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ddc95a9-b037-4f1a-9355-5d23f6c39688 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a31a9efd8dc04c9aa64c42a3779c550d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b705897907f042c0818a931052438e1e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:14:04.537875 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddc95a9-b037-4f1a-9355-5d23f6c39688 service neutron] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:14:04.538155 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddc95a9-b037-4f1a-9355-5d23f6c39688 service neutron] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:14:04.538424 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddc95a9-b037-4f1a-9355-5d23f6c39688 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:14:04.540022 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-2ddc95a9-b037-4f1a-9355-5d23f6c39688 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:14:04.619132 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:14:04.647854 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ddc95a9-b037-4f1a-9355-5d23f6c39688 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:14:04.649809 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ddc95a9-b037-4f1a-9355-5d23f6c39688 service neutron] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:14:04.667722 dv-cinder-862365-1-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 589/1167] 10.222.0.23 () {60 vars in 1365 bytes} [Fri Oct 28 19:14:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 19:14:07.294630 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117828be-369a-40d0-82da-d5bf8848319a None None] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:14:07.295211 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117828be-369a-40d0-82da-d5bf8848319a None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:14:07.295211 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117828be-369a-40d0-82da-d5bf8848319a None None] PATH_INFO: `/` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:14:07.296526 dv-cinder-862365-1-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 579/1168] 10.222.0.23 () {54 vars in 927 bytes} [Fri Oct 28 19:14:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 19:14:07.301716 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a77b1a-fff4-407c-a5b5-5dbf131887cf None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:14:07.302136 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a77b1a-fff4-407c-a5b5-5dbf131887cf None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:14:07.302278 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a77b1a-fff4-407c-a5b5-5dbf131887cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:14:07.368354 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-d5a77b1a-fff4-407c-a5b5-5dbf131887cf None None] MFA Rules not processed for user `ae863915635746d1ac19970949de4722`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:14:07.369598 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-d5a77b1a-fff4-407c-a5b5-5dbf131887cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:14:07.464721 dv-cinder-862365-1-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 590/1169] 10.222.0.23 () {58 vars in 1024 bytes} [Fri Oct 28 19:14:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 19:14:07.763019 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117828be-369a-40d0-82da-d5bf8848319a None None] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:14:07.764620 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-117828be-369a-40d0-82da-d5bf8848319a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:14:07.867916 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117828be-369a-40d0-82da-d5bf8848319a None None] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:14:07.940973 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484ffe98-0737-4efb-84b3-1a13689ab870 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a31a9efd8dc04c9aa64c42a3779c550d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b705897907f042c0818a931052438e1e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:14:07.941606 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484ffe98-0737-4efb-84b3-1a13689ab870 service neutron] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:14:07.941887 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484ffe98-0737-4efb-84b3-1a13689ab870 service neutron] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:14:07.942162 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484ffe98-0737-4efb-84b3-1a13689ab870 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:14:07.944293 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-484ffe98-0737-4efb-84b3-1a13689ab870 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:14:07.953661 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:14:08.054493 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484ffe98-0737-4efb-84b3-1a13689ab870 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:14:08.055849 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484ffe98-0737-4efb-84b3-1a13689ab870 service neutron] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:14:08.074287 dv-cinder-862365-1-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 580/1170] 10.222.0.23 () {60 vars in 1365 bytes} [Fri Oct 28 19:14:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 19:14:17.463124 dv-cinder-862365-1-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=82 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:14:18.071986 dv-cinder-862365-1-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=50 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}